新基准 ProgramDistill：编程 Agent 只走到人类开发者 49%

Jeonghye Kim @beanie0__0原推发布于 2026.09.17

在 X 上打开原推

🤖 How far are coding agents from working like human developers? GPT-6 Astra has made big advances in many areas, including coding. ❓ So, can Astra replace a human developer? Our new benchmark says ❗we’re about 49% of the way there.❗ Developers don’t build apps from written requirements alone. They constantly use references—existing apps, UI/UX mockups, prototypes—to see how things should look and work. Then they build it and check their work against the reference. ✨ Introducing ProgramDistill, a benchmark and synthetic task-generation pipeline for testing coding agents on this workflow at scale.