AI Can Solve Your Benchmark. Can It Fix Your Codebase?

The most informative thing about AI’s current capabilities in software engineering is not what it can do on a benchmark. It’s who the benchmark is comparing it against.…