MoE Capacity Factor: Why Mixture-of-Experts Drops Your Tokens
🔒
https://dev.to
«Your Mixture-of-Experts fine-tune looks clean in eval and degrades in production, and the degradation tracks concurrency rather than input difficulty. Nothing throws. Logits look normal. The usual suspects — sampling par...»
Automatische Weiterleitung...
1.5s