1,000 AI agents, 0 LLM calls?

Author: Google Cloud Tech - Bewertung: 0x - Views:45

A thousand AI agents run a marathon, and almost none of them ever call the LLM. Check out the full tutorial on our channel and learn:

- When to use an LLM vs deterministic logic

- The before_model_callback trick, keep the agent, skip the model

- Why route planning is deterministic (NP-hard + the Spine & Sprout algorithm)

- How 1,000 autopilot runners make 0 LLM calls

- Where the tokens actually go (the AI decides, the code runs)

- Scaling 1,000 stateless sessions with Redis



Speakers: Casey West, Annie Wang

Products Mentioned: Google Agent Development Kit, Gemini API, Agent Runtime, Google Cloud Pub/Sub, AlloyDB, Agent2Agent Protocol