Prompt Size Is Becoming an Architecture Metric

A coding agent can access an entire repository, so it is tempting to give it more of the repository. A RAG pipeline retrieves ten documents, so why not pass all ten? An agent returns a tool result, so we append it to the conversation and carry it into the next iteration. Nothing fails immediately. The model still responds, the answer may still... Weiterlesen