🔧 MoE Capacity Factor: Why Mixture-of-Experts Drops Your Tokens

Your Mixture-of-Experts fine-tune looks clean in eval and degrades in production, and the degradation tracks concurrency rather than input difficulty. Nothing throws. Logits look normal. The usual suspects — sampling params, quantization, prompt drift — all check out. The culprit is often the MoE capacity factor: a fixed-size buffer per expert...