vLLM says it matches DeepSeek's DeepInfer on V4.1 Flash decoding
The vLLM team reports matching DeepSeek's in-house DeepInfer engine on V4.1 Flash decode across batch sizes 8–256 by adopting DeepSeek's open-source kernels and tuning prefill and decode.
How much speed do you give up by not running a lab's own inference engine? For DeepSeek-V4.1-Flash, maybe none. The vLLM team says vLLM now matches DeepInfer, DeepSeek's in-house engine, on DeepSeek's decode configuration across batch sizes 8 to 256. They got there by pulling in DeepSeek's open-source kernels and doing a lot of prefill and decode tuning, and they ran it at DEP32 where DeepInfer used EP64DP64. Fun detail: DeepInfer was originally built on vLLM, so open source came full circle here. If you serve DeepSeek models, rerun your own benchmark on the latest vLLM with your real prompt lengths before you take on a second serving stack. Link in Comments