BrokenArXiv 与 ArXivMath 新基准：Astra 居首

Jasper Dekoninck @j_dekoninck原推发布于 2026.09.16

在 X 上打开原推

We are releasing the latest version of BrokenArXiv and ArXivMath! These benchmarks now focus on conjectures that were refuted in the last month on ArXiv, and models are executed within a harness instead of directly via API. Performance remains impressive, with GPT-6 Astra on top