deepseek-v4.1IMAGE
双 3090 老工作站跑 DeepSeek V4.1 Flash:1M 上下文 25 tok/s
在 2014 年 DDR4 工作站的双 3090 上用 ISTA IQ2_XXS 量化跑 DeepSeek-V4.1-Flash-1017,1M 上下文下达到 25 tok/s。
Runner
@RRunner1445 天前收录原推发布于 2026.10.25

Runner @RRunner144原推发布于 2026.10.25
Back home, got DeepSeek-V4.1-Flash-1017 on a pair of 3090s in a 2014 DDR4 workstation doing 25 tok/s using 1M context. I can't stop laughing and I know Nikos is only going to make this thing faster. ISTA IQ2_XXS Quant using 1M context
这条是引用着另一条写的:x.com/rrunner144/status/2114016152351338909
x.com/rrunner144/status/2114162596521607559采集于 2026.10.25 12:00