91% Passed, 25% Safe: Why Your Coding Agent Ships Code That Works and Gets You Hacked

A new benchmark took 150 real vulnerabilities, handed the broken code to six frontier agents, and graded the output the way an attacker would. The best agent got 91.1% of the tasks working. Only 25.1% of them were also safe to ship. The Java config importer that passed every test One task in the benchmark asks an agent to rewrite the missing file... Weiterlesen: 91% Passed, 25% Safe: Why Your Coding Agent Ships Code That Works and…