WHAT NEW IN X10.31 SAT

X 上的 AI 合集档案 · 22 个合集 · 63,170 条

gpt-6POST

Bug 猎杀榜 FAQ:Sonnet 5.5 靠 7 倍轮数追平 Astra

基准作者解释榜单细节:题目是 2026 年初前沿模型真实漏掉的 bug,Sonnet 5.5 靠比 GPT-6 Astra 多花 7 倍轮数拿到该分数,未植入的 bug 不计分。

Paweł Huryn
@PawelHuryn13 天前收录原推发布于 2026.10.17
Paweł Huryn @PawelHuryn原推发布于 2026.10.17
在 X 上打开原推

Before more data drops, FAQ: 1. Those are real bugs frontier models missed at the beginning of 2026 2. The score for Sonnet 5.5 (max) is correct. It does this by spending 7x more turns than GPT-6 Astra (max). 3. Unplanted bugs aren't counted. Some OpenAI models report many real, irrelevant issues to max the benchmark. 4. Yes there are more models and more effort levels. You can adjust the filters and see live results here: https://bughunt.productcompass.pm/

x.com/pawelhuryn/status/2111412124245229942采集于 2026.10.18 16:00