gpt-6IMAGE
Crux 复测:Astra 与 Fable 5.1 各拿 $1 万做研究,论文仍被原作者拒
用未发表论文的开放问题让 GPT-6 Astra 和 Claude Fable 5.1 各花 $1 万做研究,实验设计与资源管理较 7 月 Opus 4.8 测试明显进步,但创意解题、判断与表达仍弱,两篇论文都被专家拒稿。
Peter Kirgis
@pkirgis9 天前收录原推发布于 2026.10.21

Peter Kirgis @pkirgis原推发布于 2026.10.21
We gave GPT-6 Astra and Claude Fable 5.1 open-ended AI research questions from unpublished papers, with a $10,000 budget each, and had the original authors grade the papers they produced. Compared to our first tests with Claude Opus 4.8 in July, we saw meaningful improvements in experimental design and resource management, but persistent limitations in creative problem solving, judgment, calibration, and communication; both papers were rejected by our experts. https://cruxevals.com/research-notes/crux-2-followup
x.com/pkirgis/status/2112617994496991379采集于 2026.10.21 10:06