Agent Arena: DeepSeek V4.1 Flash 1017 tops open models at #11 overall
Agent Arena ranks DeepSeek-V4.1-Flash-20261017 #11 overall and #1 among open models, with +5.1% net gain over 7.5K sessions and $0.20 median cost per task, about 27% of GPT-6.1 Sol's cost for 37% of its gain.
Big news: DeepSeek-V4.1-Flash-20261017 (Max) by @deepseek_ai is now the #1 open model in Agent Arena! It just landed at #11 overall with +5.1% net improvement across +7.5K real-world sessions. This performance also reshapes the Agent Arena Pareto frontier! All models above V4.1-Flash 20261017 in performance are proprietary at much higher cost. At $0.20 median cost per task, that’s ~37% of GPT-6.1 Sol’s improvement for about 27% of the cost. By signal, this release achieves: - #8 in Confirmed Success with +11.5% (#1 open) - #11 in Praise vs. Complaint with +5.9% (#1 open) - #12 in Bash Reliability with +5.4% (#1 open) - #13 in Steerability with +2.5% (#1 open) - No issues with Tool Hallucination Find more info on signals at the link in thread on Agent Arena. Congrats to the @deepseek_ai team on this release!
This post quotes another post: x.com/arena/status/2111894091168682086