Aikido 提前拿到 GPT-6 Astra 跑安全基准

pilvar (Philippe Dourassov) @pilvar222原推发布于 2026.09.05

在 X 上打开原推

HOLY MOLY: @AikidoSecurity got GPT-6 Astra in advance to run it on our Cybersecurity benchmark, it crushed EVERY other model! - At pass@3 it rediscovered 29/32 CVEs, the highest recall we've ever recorded and 4 more than GPT-5.6-Sol - Even at pass@1, it has 75% recall. The model is VERY consistent - The performance however come at a high price (literally). The three runs cost us almost $4,000 Astra is now the #1 model on the benchmark @iminurputer and I built, and by a LOT 1/3 🧵