🔧 Spring AI Prompt Caching and Chat Memory: Where the Tokens Go — LLM Cost Control 2/4

Suppose the metrics are in place, each task has the model it actually needs, and every feature has its own client — that was Part 1. The next thing to look at is what those clients send and receive.

This part is about controls for output token generation, chat memory and static input tokens.


Driver #3 — Output and reasoning tokens: the...