GPT-6.1 Sol 极速版改用英伟达 GPU 的影响
分析称 OpenAI 新的 Ultrafast 档跑在英伟达 GPU 上而非 Cerebras,削弱了快速推理必须用晶圆级芯片的论点,并关注 Astra 用哪家硬件。
$NVDA $CBRS The implications of this are REALLY interesting for fast inference. OpenAI's new GPT-6.1 Sol Ultrafast tier is reportedly running on Nvidia GPUs at low batch size, while the previous version ran on Cerebras at up to 750 tokens per second. For Nvidia, the win is less about volume and more about the moat. Ultrafast is a small premium tier for now, but GPUs just showed they can serve the speed tier too, which weakens the case that you need wafer-scale chips or custom ASICs for fast inference. And low batch means more GPUs for every token, so if speed tiers grow, so does the GPU bill. For Cerebras, it's lost its exclusivity on OpenAI's speed tier, but not its speed lead. Nvidia runs the new model at about 300 tokens per second, while Cerebras ran the previous one at 750, and OpenAI still has up to 750 MW of Cerebras systems staged through 2028. I'm watching closely now which hardware powers Ultrafast for GPT-6 Astra, OpenAI's flagship. If it's Cerebras, this is a capacity story. If it's Nvidia, it's a real problem for CBRS. Nvidia really isn’t leaving scraps for anyone.
这条是引用着另一条写的:x.com/semianalysis_/status/2105055045959995719