DeepSeek V4.1-Flash-1017 vs GPT-5.6 Sol and Opus 5: benchmark lead at a fraction of the price
Vendor-reported scores including DeepSWE 77.0, Automation-Bench 60.5 and Apex Bench 72.1 top Sol and Opus 5, with per-million-token pricing of $0.15/$0.60 off-peak versus $4/$20 and $5/$25.
DeepSeek V4.1-Flash-1017 is seriously impressive. The new update beats GPT-5.6 Sol and Claude Opus 5 on several coding and agent benchmarks, at a fraction of their API prices. Key benchmark results: • DeepSWE: 77.0 vs 73.0 (Sol) and 74.0 (Opus 5). • Automation-Bench: 60.5 vs 45.8 (Sol) and 50.3 (Opus 5). • Agents' Last Exam: 35.4 vs 26.7 (Sol) and 28.6 (Opus 5). • Apex Bench: 72.1 vs 54.3 (Sol) and 65.8 (Opus 5). API pricing per 1M tokens (input/output): • DeepSeek Flash: $0.15 / $0.60 off-peak, $0.30 / $1.20 peak. • GPT-5.6 Sol: $4 / $20. • Claude Opus 5: $5 / $25. These are DeepSeek's reported benchmarks, and Opus 5 still leads in several other tests. DeepSeek also reports shorter outputs and faster task completion. Open weights under MIT. 1M-token context window. The price-performance gap is getting interesting.
This post quotes another post: x.com/openmodelsai/status/2111378754928787480