WHAT NEW IN X11.04 WED

AI collections from X · 22 collections · 66,612 posts

gemini-4IMAGE

Gemini 4 Argon places second on VulnPR-100 with 57 vulnerabilities found

BugBunny tested Gemini 4 Argon on 100 pull requests with known vulnerabilities; it found 57 for $166.40, placing second and uncovering a flaw every previously tested model missed.

Z A D D Y
@ZaddyzaddyArchived 20 days agoOriginally posted 2026.10.14
Gemini 4 Argon places second on VulnPR-100 with 57 vulnerabilities found (image 1 of 2)
Gemini 4 Argon places second on VulnPR-100 with 57 vulnerabilities found (image 2 of 2)
Z A D D Y @ZaddyzaddyOriginally posted 2026.10.14
Open original on X

We gave Google's new Gemini 4 Argon 100 pull requests with known vulnerabilities and an hour per PR to find them in the @BugBunny_ai VulnPR-100 benchmark. It found 57 for $166.40, placing second overall. Only Grok 4.7 found more with 62, but it cost $338.67, just over twice as much. Argon also beat GPT-5.6 Sol by seven findings while costing $114 less. The most interesting result: Argon found a vulnerability missed by every model we had previously tested. That pushes combined benchmark coverage from 89 to 90 of 100 cases. The additional recall is not cheap. mimo-v2.6-pro found 46 for $8.27, while DeepSeek V4.1 Flash found 44 for $12.79. Argon gains another 11 to 13 findings, but at 13 to 20 times the review cost. Still, second place overall and genuinely new coverage is a strong result for Gemini 4 Argon.

x.com/zaddyzaddy/status/2110091199713255559Archived 2026.10.14 10:01