Breken 生产环境 bug 测试成绩对比 GPT-6 Astra
Breken 在 33 个产品的评测中抓到 235 个真实生产 bug 里的 76 个,Fable 5.1 为 37 个、GPT-6 Astra 为 28 个,误报还少三分之一。

your tests check what your team thought of, while production checks everything else up until now, real users were basically running that second test. what stood out to me about @brekenai is that it builds a realistic world around your real software, real users, old data, and things breaking on purpose; finds the bugs that only show up in production; fixes them; then keeps checking every release in its evaluation across 33 products, Breken caught 76 of 235 real production bugs, compared with 37 for Fable 5.1 and 28 for GPT-6 Astra, with a third of the false alarms they’re calling it production engineering, the final job in software if you're building a startup, give it a try 👇
这条是引用着另一条写的:x.com/brekenai/status/2112936781087973732