五模型找 Bug 实测：Sonnet 5.5 反超 GPT-6 Astra
两个真实仓库、105 个已知 Bug，Sonnet 5.5 最高档平均找出 55.5 个，GPT-6 Astra 45 个，Opus 5.5 41.7 个，但 Sonnet 代价是约三倍轮次。
.@PawelHuryn gave five models two real repos with 105 known bugs. Sonnet 5.5 at max found the most: 55.5 on average. GPT-6 Astra: 45. Opus 5.5: 41.7. the cheaper model beat the flagship at finding bugs. the price of that: 1,330 turns, about three times what Opus used. drop Sonnet to xhigh and its turns fall by more than half. its score falls to 39. so the most thorough setting and the cheapest setting are the same model on two different dials. want every bug before a release? Sonnet at max, and budget for the turns. want a fast pass on every PR? lower effort, and accept you'll miss some. one builder's test on his repos, not a benchmark. worth knowing before you set your review agent to max.
这条是引用着另一条写的：x.com/neil_xbt/status/2105292880797483484