🔧 What Broke After 10M WebSocket Events (And How We Fixed Our Realtime AI Orchestration)

Introduction


We built a realtime AI feature for a multi-tenant SaaS: live agent assistants that coordinate across services and update UIs via WebSockets. It worked great in staging. In production, after a few million messages, latency spiked, connections dropped, and our monitoring dashboards lied to us.

Here’s what we learned the hard way...