Mistral Small: 58 empty replies in 300 tool calls, and the retry loop

On 300 public function-calling tasks, Mistral Small (2603) returned an empty reply 58 times, even after two retries. That is 19.3% of tasks with nothing to parse, and it is why a model priced at $0.15 per million input tokens ended up at $0.000098 per successful task against $0.000051 for GPT-6 Luna, which passes 93.0% with no retries at all. Here... Weiterlesen: Mistral Small: 58 empty replies in 300 tool calls, and the retry loop