Two days ago, Gemma 4 topped our local model benchmark — 167 tokens per second, perfect code quality score, smallest download. Faster than Sonnet. Faster than Opus. The blog post said "Gemma 4 is the new default."

Today we tested whether that's actually true.




The Experiment


Instead of another toy benchmark, we pulled a real item off...