WHAT NEW IN X10.30 FRI

X 上的 AI 合集档案 · 22 个合集 · 60,637 条

deepseek-v4.1POST

R9700 本地跑 DeepSeek V4.1 Flash:Strata 0.2.6 提速实测

Strata 0.2.6 把 CPU 侧专家全部预载进内存后,单卡 R9700 代码解码从 24.5 升到 27.6 tok/s,四卡从 77 升到 84.7 tok/s,代价是加载时间从 34 秒变 55 秒。

Adam
@dad__vibes2 天前收录原推发布于 2026.10.27
Adam @dad__vibes原推发布于 2026.10.27
在 X 上打开原推

Radeon AI PRO R9700 test PCs with 251 GB of RAM. DeepSeek V4.1-Flash on Strata 0.2.6 (Linux, HIP), which now copies every CPU-side expert into RAM at load when they all fit with 8 GiB to spare. Decode, before / now: 1x R9700, set 2.00, code: 24.5 / 27.6 tok/s 1x R9700, set 2.00, agent: 21.9 / 27.1 1x R9700, set 2.25, code: 26.1 / 29.6 1x R9700, set 2.25, agent: 23.1 / 27.0 4x R9700, set 2.00, code: 76.6-77.0 / 84.7 4x R9700, set 2.00, agent: 74.2 / 83.3 Trade-off: one R9700 now loads the 2.00 set in about 55 s instead of 34 s, because it copies 108 GB. If the RAM is already in the box, that's free speed on the same card. via Strata release notes: https://github.com/Niko1221/Strata/releases/tag/v0.2.6 · cc @AMD @RadeonPRO #LocalLLM #ROCm

x.com/dad__vibes/status/2114805976553701829采集于 2026.10.27 12:09