If you're using LiteLLM for failover, you probably expect instant provider switching when OpenAI goes down. Configure fallback to Anthropic, requests route automatically, users never notice.

That's the theory. Here's the reality: your requests might be hanging for 30+ seconds before fallback even triggers.

This post breaks down how LiteLLM's...