Fortune:OpenAI 发布前后改过 Astra 跑分
报道称 Astra 发布博客延迟期间,幻觉率从 4.2% 改到 2% 又改回,Fable 5.1 的 FrontierMath 分数也来回变动,OpenAI 称与跑分无关。

Interesting report from FORTUNE: @OpenAI quietly changed several GPT-6 Astra benchmark results around the model's launch, with some changes making Astra look better and competing models worse. One of the biggest examples: Astra's reported hallucination rate went from 4.2% to 2%, before later being changed back to 4.2%. Anthropic Fable 5.1's FrontierMath score also moved from 87.8% to 78%, then back up to 83%. This happened during the strange delay of the Astra launch blog, which was initially published, pulled, and then republished with different numbers. OpenAI says the delay was unrelated to the benchmarks and that eval results can shift depending on the exact checkpoint, harness and reasoning configuration.