AI pair-programming became useful when every idea met a benchmark

The most confident optimization suggestions were not always the useful ones. An 8 by 8 register block sounded better than 4 by 4 because it offered more reuse. It ran slower. Packed f16 storage sounded additive with tiling. It was not. A vectorized kernel won its standalone benchmark and initially broke the real training loop. The productive... Weiterlesen