deepseek-v4.1IMAGE
748B 的 V4.1-1017 在单台迷你主机上跑 1-bit 量化,约 14 tok/s
Ryzen AI Max+ 395 加 128GB 内存和 USB4 eGPU 的 R9700,在 Windows 上跑 1-bit 量化,128K 上下文约 14 tok/s,eGPU、iGPU、CPU、SSD 分担权重。
Mike Gannotti 🔳
@MichaelGannotti9 天前收录原推发布于 2026.10.22

Mike Gannotti 🔳 @MichaelGannotti原推发布于 2026.10.22
Okay this is nuts. Yuxuan Cao got DeepSeek V4.1-1017, the 748B one (16B active), running on a single mini PC. Ryzen AI Max+ 395 with 128GB, plus an R9700 in a USB4 eGPU dock. On Windows. 1-bit quant, ~14 tok/s, 128K context. The clever bit is the split: eGPU, iGPU, CPU and even the SSD each hold a piece. Their note says Windows was the hard part and Linux would do better. Not fast, but it runs at home.
x.com/michaelgannotti/status/2113298924978982978采集于 2026.10.23 12:08