NerfBench launches to track whether models get worse after release
BridgeBench launched NerfBench, which retests models on the same tasks and prompts against their day-one results, starting with Claude Opus 5.5 and GPT-6 Astra.
I'm tired of frontier models getting nerfed after launch. Every release it's the same cycle. Day one the model is incredible. A few weeks later it feels lazier and dumber, everyone swears it got quantized, and the labs say nothing changed. Nobody has receipts. So we built NerfBench. BridgeBench retests models against their own day one results. Same tasks, same prompts. If a model gets worse, you'll see exactly how much. Claude Opus 5.5 and GPT 6 Astra are first up. Right now Opus 5.5 is the best model I've used. NerfBench is how we find out if it stays that way.
This post quotes another post: x.com/bridgemindai/status/2103825430189109688