Aikido gets early GPT-6 Astra access for security benchmark

pilvar (Philippe Dourassov) @pilvar222Originally posted 2026.09.05

Open original on X

HOLY MOLY: @AikidoSecurity got GPT-6 Astra in advance to run it on our Cybersecurity benchmark, it crushed EVERY other model! - At pass@3 it rediscovered 29/32 CVEs, the highest recall we've ever recorded and 4 more than GPT-5.6-Sol - Even at pass@1, it has 75% recall. The model is VERY consistent - The performance however come at a high price (literally). The three runs cost us almost $4,000 Astra is now the #1 model on the benchmark @iminurputer and I built, and by a LOT 1/3 🧵