Google for Developers: Per-Layer Embeddings (PLE) in Gemma 4 explained

Learn how per-layer embeddings, or PLE, work in Gemma 4 E2B and E4B, Google's open source language model. Google DeepMind’s Maarten Grootendorst breaks down how PLE gives each token a layer-specific embedding for more diverse representation, boosting model performance without increasing the parameters used during computation.



Subscribe to Google for Developers → https://goo.gle/developers



Products Mentioned: Gemma 4

Speaker: Maarten Grootendorst