LisanBench without edit-distance rule: GPT 6 Astra leads Gemini 4 Argon
A post cites LisanBench's re-ranking without the edit-distance rule, with GPT 6 Astra medium first, Gemini 4 Argon high second and GPT 6.1 Sol medium third, noting all three confirmed loopers.
it's good to know that OpenAI models are at least SOTA on a subtask of LisanBench: "When scoring the models without the edit-distance one rule (all the other rules still active) the ranking changes completely: 1. GPT 6 Astra medium: 56,140 (+659%) 2. Gemini 4 Argon high: 51,312 (+579%) 3. GPT 6.1 Sol medium: 49,887 (+731%)" ALL THREE CONFIRMED LOOPERS AT THE TOP 👀
This post quotes another post: “LisanBench update: Gemini 4 Argon low tops non-thinking leaderboard”