WHAT NEW IN X10.30 FRI

X 上的 AI 合集档案 · 22 个合集 · 61,305 条

gpt-6IMAGE

Crux 复测:Astra 与 Fable 5.1 各拿 $1 万做研究,论文仍被原作者拒

用未发表论文的开放问题让 GPT-6 Astra 和 Claude Fable 5.1 各花 $1 万做研究,实验设计与资源管理较 7 月 Opus 4.8 测试明显进步,但创意解题、判断与表达仍弱,两篇论文都被专家拒稿。

Peter Kirgis
@pkirgis9 天前收录原推发布于 2026.10.21
Crux 复测:Astra 与 Fable 5.1 各拿 $1 万做研究,论文仍被原作者拒
Peter Kirgis @pkirgis原推发布于 2026.10.21
在 X 上打开原推

We gave GPT-6 Astra and Claude Fable 5.1 open-ended AI research questions from unpublished papers, with a $10,000 budget each, and had the original authors grade the papers they produced. Compared to our first tests with Claude Opus 4.8 in July, we saw meaningful improvements in experimental design and resource management, but persistent limitations in creative problem solving, judgment, calibration, and communication; both papers were rejected by our experts. https://cruxevals.com/research-notes/crux-2-followup

x.com/pkirgis/status/2112617994496991379采集于 2026.10.21 10:06