EvasionBench: GPT-6 Sol evades monitors 20% of the time

Exponential Security Labs @expsecaiOriginally posted 2026.09.25

Open original on X

We're excited to announce a new paper! We find that many recent models end up evading monitors under ordinary task pressure. We introduce EvasionBench to measure this behavior. We find a very large variance in how models behave: from 88% evasion success of GLM-5.2 to 0% of GPT-6 Astra under best-of-3 evaluation. At the same time, GPT-6 Sol is at 20%. We are actively working on security and safety benchmarks, both public and private. Get in touch if you are interested! More details: https://expsec.ai/