deepseek-v4.1IMAGE

DeepSeek V4.1 Flash-1017 in DeepSeek Harness: 16/16 at 9k reasoning budget, 3 of 6 runs timed out

On an M3 Ultra with DeepSeek Harness, V4.1 Flash-1017 hit 16/16 in one run at reasoning 40 with a 9k budget, but output consistency dropped and 3 of 6 runs hit the 210-minute timeout.

Kev

@KevrsubArchived 9 days agoOriginally posted 2026.10.23

DeepSeek V4.1 Flash-1017 in DeepSeek Harness: 16/16 at 9k reasoning budget, 3 of 6 runs timed out (image 1 of 2)

DeepSeek V4.1 Flash-1017 in DeepSeek Harness: 16/16 at 9k reasoning budget, 3 of 6 runs timed out (image 2 of 2)

Kev @KevrsubOriginally posted 2026.10.23

Open original on X

Final testing of Deepseek v4.1-Flash-1017 in the Deepseek harness. Reasoning 40 with a reasoning budget of 9k. This Bench hit 16/16 (100%) for 1 run of 6. This ceiling is real and it is higher but the output is less consistent with the range widening. Run times are longer and the full runtime was needed on an M3 Ultra. Timeouts were set to 210 minutes and this was hit 3 out of 6 times. This is the best scoring model I have benched locally to date. Again - a reasoning effort using PI is not equivalent to the same reasoning effort in DSH.

x.com/kevrsub/status/2113409258653880760Archived 2026.10.23 12:06