deepseek-v4.1IMAGE
V4.1 Flash 去审查版 3.5bpw 量化:7 张 3090 上 50 tok/s
有人用 Project Maya 引擎在 7×3090 + 256GB 内存上跑 DeepSeek-V4.1-Flash-1017 的 EXL3 3.5bpw 去审查量化,解码约 50 tok/s,权重约 260GB。
Axitek
@axitek10 天前收录原推发布于 2026.10.22

Axitek @axitek原推发布于 2026.10.22
DeekSeek-v4.1-Flash-1017-Uncensored at 3.5bpw, running on Maya v1.1.20 at 50 tps decode 🚀 This is HUGE - like, 260gb weights + 200gb engrams, running on 168gb vram - all thanks to Project Maya. Model: https://huggingface.co/neko-legends/DeepSeek-V4.1-Flash-1017-EXL3-3.5bpw-UNCENSORED-4xSpark Engine: https://github.com/mw00/project-maya H/W 7x3090+256gb
x.com/axitek/status/2112996349000192267采集于 2026.10.22 12:01