A client came to me in early 2024 with a fully built AI agent that kept timing out in production. The retrieval step took 800ms on average and occasionally spiked past two seconds. Their users were abandoning queries. The "AI is too slow" complaint was killing adoption of a system that had otherwise cost them $180,000 to build.

The culprit?...