WHAT NEW IN X11.04 WED

AI collections from X · 22 collections · 67,905 posts

gemini-4IMAGE

Gemini 4 Argon ranks fourth on 105 real bug fixes frontier models missed

A test on two repos with 105 bugs that frontier models missed in Q1 2026 scored GPT-6 Astra at 45, Fable 5.1 at 43, Opus 5.5 at 41.7, Gemini 4 Argon at 33, Muse Spark 1.3 at 32.2 and Grok 4.7 at 29.

Paweł Huryn
@PawelHurynArchived 21 days agoOriginally posted 2026.10.14
Gemini 4 Argon ranks fourth on 105 real bug fixes frontier models missed
Paweł Huryn @PawelHurynOriginally posted 2026.10.14
Open original on X

I tested Gemini 4 Argon on real work. 2 repos. 105 bugs frontier models missed in Q1 2026. Find and fix what you can. The results: GPT-6 Astra (max): 45 Fable 5.1 (max): 43 Opus 5.5 (max): 41.7 Gemini 4 Argon (high, its max): 33 Muse Spark 1.3 (max): 32.2 Grok 4.7 (xhigh, its max): 29 A way better model than Gemini 3.8 Flash, tested at its max. Based on the history, the uncertainty is 2-3 points. Looks like the Google is back.

x.com/pawelhuryn/status/2110154067456495708Archived 2026.10.14 10:01