A6000 双卡 TP=2 + DGX Spark 混合部署 V4.1 Flash 的移植记录

Jeremy Tregunna @noozie原推发布于 2026.10.24

在 X 上打开原推

Spent my evening and now part of my morning porting TensorFold to run on Ampere generation A6000 GPUs in TP=2, while keeping all experts on the GPUs, all other weights on a dgx spark, and yet remaining things in memory on the GPU node. Yeah I'm trying to see how far I can push the hardware I have, and DeepSeek V4.1 Flash 1017 seems like it was built to help me with that. 384GB ram, 48GB x 2 VRAM, 128GB Unified memory and an rdma link between gpu node and spark... About 75% done the code prepping for first test today.