SGLang v0.5.22:V4.1 Flash 在 Hopper 上输出吞吐最高 2.3 倍
SGLang v0.5.22 发布,950 个 PR;DeepSeek-V4.1-Flash 在 Hopper 上输出 token 吞吐最高提升 2.3 倍,另有 InstantTensor 权重加载快 10 倍等更新。

SGLang v0.5.22 is out! 950 PRs from 245 contributors, including 69 new contributors 🧡 Some of our favorite updates: - InstantTensor brings up to 10x faster weight loading - DeepSeek-V4.1-Flash gets up to 2.3x output token throughput on Hopper - Up to 2.1x faster decoding on GLM-5.3, with decode context parallelism with MTP - PD disaggregation gets up to 27% more throughput and half the p95 TTFT on agentic tasks - MiMo-V2.6-Pro gets 1.85x decode throughput with DFlash - Apple Silicon Macs can now use the standard PyTorch/MPS backend alongside MLX - SGLang Diffusion now supports community GGUF checkpoints and LoRAs on ComfyUI New models include Clef / Clef Flash, PPLX-Decider v1 / v1.1, EmbeddingGemma 2, LLaDA2.2, HunyuanImage-3.0-Instruct, Kandinsky 6, SANA-Video 2.0, and more. Full release notes: http://github.com/sgl-project/sglang/releases/tag/v0.5.22