WHAT NEW IN X10.29 THU

X 上的 AI 合集档案 · 22 个合集 · 60,637 条

gpt-6IMAGE

Fortune:OpenAI 发布前后改过 Astra 跑分

报道称 Astra 发布博客延迟期间,幻觉率从 4.2% 改到 2% 又改回,Fable 5.1 的 FrontierMath 分数也来回变动,OpenAI 称与跑分无关。

Mark Kretschmann
@mark_k2026.09.14收录原推发布于 2026.09.05
Fortune:OpenAI 发布前后改过 Astra 跑分
Mark Kretschmann @mark_k原推发布于 2026.09.05
在 X 上打开原推

Interesting report from FORTUNE: @OpenAI quietly changed several GPT-6 Astra benchmark results around the model's launch, with some changes making Astra look better and competing models worse. One of the biggest examples: Astra's reported hallucination rate went from 4.2% to 2%, before later being changed back to 4.2%. Anthropic Fable 5.1's FrontierMath score also moved from 87.8% to 78%, then back up to 83%. This happened during the strange delay of the Astra launch blog, which was initially published, pulled, and then republished with different numbers. OpenAI says the delay was unrelated to the benchmarks and that eval results can shift depending on the exact checkpoint, harness and reasoning configuration.

x.com/mark_k/status/2096258675077738963采集于 2026.09.14 15:53