WHAT NEW IN X10.28 WED

X 上的 AI 合集档案 · 22 个合集 · 58,924 条

benchmarkIMAGE

105 个真实 bug 修 bug 横评:Sonnet 5.5 领先 Astra

两个真实仓库 105 个 bug 的修复测试中,Sonnet 5.5 max 得 55.5 分,GPT-6 Astra max 45 分,靠多轮次取胜。

Paweł Huryn
@PawelHuryn28 天前收录原推发布于 2026.09.29
105 个真实 bug 修 bug 横评:Sonnet 5.5 领先 Astra
Paweł Huryn @PawelHuryn原推发布于 2026.09.29
在 X 上打开原推

I tested Sonnet 5.5 and couldn't believe my eyes. 2 real repos, 105 bugs, find and fix what you can. It took it seriously. The results: - Sonnet 5.5 (max): 55.5 - GPT-6 Astra (max): 45 - GPT-5.6 Sol (max): 43.5 - Fable 5.1 (max): 43 - Opus 5.5 (max): 41.7 - Sonnet 5.5 (xhigh): 39 The secret? Sonnet 5.5 (max) might be cheap and fast for most tasks, but it's the least lazy model I tested. It leads in bug hunting by spending turns. It took about 6× Astra's turns and about 3× Opus 5.5's for 10–14 more bugs. xhigh cut its turns by more than half and dropped to 39, below Opus 5.5 max, which used fewer turns on average: - Sonnet 5.5 (max): 1,330 turns (n=2) - GPT-6 Astra (max): 222 turns (n=3) - GPT-5.6 Sol (max): 1,083 turns (n=2) - Fable 5.1 (max): 459 turns (n=1) - Opus 5.5 (max): 476 turns (n=3) - Sonnet 5.5 (xhigh): 588 turns (n=1) More effort levels for Sonnet 5.5 with n=3 drop in this thread today 🧵

x.com/pawelhuryn/status/2104818995316527105采集于 2026.09.30 10:24