For the past few years, we’ve been trying to build reliable systems on top of LLMs using prompts, templates, retries, validation layers, guardrails, and a pile of patches. But the truth is simple and uncomfortable:

LLMs were never designed to be reliable components. They hallucinate, drift, reorder fields, forget constraints, break schemas, and...