V4.1 Flash 1017 benchmark roundup: beats GPT 5.6 Sol on Terminal-Bench at ~1/17 cost
A roundup claims V4.1 Flash 1017 tops GPT 5.6 Sol on Terminal-Bench at ~1/17 cost, scores 77% on DeepSWE 1.1 at ~$0.20 per task, finds 54/100 vulns for $7.53, and runs 85% cheaper than Gemini 4 Argon.
The whale never disappoints 🐋 DeepSeek V4.1 Flash 1017 dropped a few hours ago, and the open-weight model is going toe to toe with US frontier models: > Beats GPT 5.6 Sol on Terminal-Bench at ~17x lower cost, jumping 11 points over the previous Flash in a single update > 77% on DeepSWE 1.1, ahead of GPT 5.6 Sol, Opus 5, GLM-5.3 and Kimi K3, for about 20 cents per completed coding task > Leads GPT 5.6 Sol and Opus 5 on Automation-Bench and Agents' Last Exam, the multi-step tool-use tests where agents usually fall apart > Found 54 of 100 known vulnerabilities in pull requests for $7.53 in total, cheap enough to run a security pass on every PR > Ran 85% cheaper and twice as fast as Gemini 4 Argon in a head-to-head test, while landing close on quality > Rebuilt Portal 2 in Godot, a playable racing game and a 3D Forbidden City, each from a short prompt > Open weights under MIT, released the same day, so anyone can download the exact checkpoint No new architecture, just RL training on coding agent harnesses with the model learning from its own feedback. Every benchmark DeepSeek published went up, and answers got shorter, so every task uses fewer tokens. Frontier-level coding at a fraction of the price of US models. Live on SPRO now: > $0.15 in / $0.60 out per 1M tokens > Cached input at $0.003 per 1M tokens for long agent runs > 1M context, up to 393K output tokens > Model ID: deepseek-v4.1-flash-1017 Same API, with guardrails, caching and spend limits on every call. https://spro.hridaai.com/explore/models/deepseek/deepseek-v4.1-flash-1017 #DeepSeek #LLM #AIGateway
This post quotes another post: x.com/deepseek_ai/status/2111375640717033777