'No peanuts' became include_ingredients: ["peanuts"]: a benchmark for tool calls a validator cannot catch

This is a submission for the DEV x Kaggle Benchmarking Challenge. What I Benchmarked An agent I was running called a ranking tool with limit: 8. The tool had no limit parameter and rejected the call: unknown argument "limit". I wanted to know how often models do that, so I built a benchmark around one question: what does a model do when the tool... Weiterlesen: 'No peanuts' became include_ingredients: ["peanuts"]: a benchmark for…