WeirdML 基准被 GPT-6 Astra 打到饱和：93.6% / 93.3%

Håvard Ihle @htihle原推发布于 2026.09.09

在 X 上打开原推

GPT 6 Astra Pro (max) and GPT 6 Astra (max) scores 93.6% and 93.3% on WeirdML, the two highest scores. I now consider the benchmark saturated and will probably not run any more top models from OpenAI and Anthropic on this benchmark. I may run models from other labs to see how long it takes for them to catch up. Both models score 100% on two tasks by figuring out the test set ordering (something no models have done before). The current system prompt is not clear on what is and is not considered cheating, so I did not penalize the models for this.

这条是引用着另一条写的：x.com/htihle/status/2096239930607374407