gemini-4POST
DeepSWE leaderboard called saturated only when Gemini tops it, user says
A user points out a double standard: Gemini 3.8 Flash topping DeepSWE was called benchmark saturation, Sol topping it was called SOTA, and Gemini 4 Argon topping it is called saturation again.
Harshith
@HarshithLucky3Archived 28 days agoOriginally posted 2026.10.01
Harshith @HarshithLucky3Originally posted 2026.10.01
that guy: when Gemini 3.8 flash topped DeepSWE - benchmark is saturated then 6.1 sol topped it - SOTA in DeepSWE Gemini 4 Argon topped it - ohh no benchmark is saturated this is not just about DeepSWE
x.com/harshithlucky3/status/2105424982071541888Archived 2026.10.01 09:59