WHAT NEW IN X10.31 SAT

X 上的 AI 合集档案 · 22 个合集 · 61,986 条

deepseek-v4.1IMAGE

按官方 Q&A 反推:DeepInfer 单集群约 2400 张 B200 日供 155 万亿 token

作者用官方推理部署 Q&A 里的 prefill/decode 吞吐、96% 缓存命中率和 77K 平均输入长度反推,单集群约 1185 对 GPU、约 2400 张 B200。

Kydo
@0xkydo5 天前收录原推发布于 2026.10.25
按官方 Q&A 反推:DeepInfer 单集群约 2400 张 B200 日供 155 万亿 token
Kydo @0xkydo原推发布于 2026.10.25
在 X 上打开原推

I don’t think folks realize just how insane DeepInfer is. One cluster with DeepInfer. IN One day. Can produce AS MUCH tokens AS OpenRouter in an entire week. “A single cluster currently serves 155 trillion tokens per day, with overall revenue of US$38 per GPU-hour (at valley pricing).” - "DeepSeek V4.1 Flash Inference Deployment Q&A" I wanted to know what “a single cluster” actually means here. So I worked backward from the numbers DeepSeek shared: -- 60,000 fresh input tokens/sec per prefill GPU -- 14,000 output tokens/sec per decode GPU -- Roughly a 1:1 prefill-to-decode GPU ratio -- 77K average input length -- 96% input cache hit rate Insane perf numbers but otherwise pretty resonable assumptions on the user side. With only 4% of input needing fresh processing, each prefill GPU serves: 60,000 ÷ 4% = 1.5 million input tokens/sec Add the decode side: 1,500,000 + 14,000 = 1,514,000 tokens/sec × 86,400 seconds = 130.8 billion tokens/day. Now divide the cluster’s reported 155 trillion by that: 155 trillion ÷ 130.8 billion ≈ 1,185 pairs. That’s ~1,185 prefill GPUs + ~1,185 decode GPUs. Roughly 2,400 B200 GPUs. And how many B200-family GPUs have shipped worldwide? An estimated 2.2–3.0 MILLION by July 2026. This cluster’s inferred GPU count is about 0.1% of that estimated shipped base. 🤯🤯🤯

x.com/0xkydo/status/2114114594058707002采集于 2026.10.25 12:00