Astra 直接在 Nvidia GPU 上写代码,绕开云软件层
作者认为 GPT-6 Astra 跑在 Nvidia GPU 而非 ASIC 上、由模型直接为 Blackwell/Rubin 编程,将冲击 AI 云与 Neocloud。
$NVDA Ultrafast and Impacts OpenAI's GPT-6 Astra runs on Nvidia GPU and not ASICs. How they did it will have a big impact to AI Clouds and Neoclouds. “NVIDIA’s deep investment in tooling and documentation has enabled us to make our models exceptionally good at programming Blackwell and Rubin GPUs” (1). Note OpenAI is using GPT it do programming directly on Nvidia GPUs, likely in PTX. This skips all the layers of Cloud Software as the application is programmed directly onto Nvidia GPUs. In the future this makes bare metal GPUs + Kubernetes the industry standard that AI Natives work the model that enables OpenAI to program directly on Nvidia GPUs will spread. All this human written Cloud Software that optimizes inference performance? OpenAI does their inference stack now using AI to write the code. In 2-3 years, this will be the big disruption as Nvidia's deep investment in tooling will allow it extend it's moat to the AI Cloud layer.