ChipokiaTech news, without the noise
← All stories
The Decoder·

AI coding agents still need human cleanup on nearly three out of four tasks in a real-world test

Alibaba's new coding-agent benchmark, Co-Design Bench, tests AI agents on real user requests that already tripped them up in practice. Even GPT-6 Astra, the top performer, fully solves only 26.4 percent of tasks. On older benchmarks, the same models score…

Preview courtesy of The Decoder. The full article opens on their site.

Other coverage of this story

More from The Decoder