Astra programs Nvidia GPUs directly, skipping the cloud software layer
The author says GPT-6 Astra runs on Nvidia GPUs rather than ASICs and programs Blackwell and Rubin directly, which could disrupt AI clouds and Neoclouds.
$NVDA Ultrafast and Impacts OpenAI's GPT-6 Astra runs on Nvidia GPU and not ASICs. How they did it will have a big impact to AI Clouds and Neoclouds. “NVIDIA’s deep investment in tooling and documentation has enabled us to make our models exceptionally good at programming Blackwell and Rubin GPUs” (1). Note OpenAI is using GPT it do programming directly on Nvidia GPUs, likely in PTX. This skips all the layers of Cloud Software as the application is programmed directly onto Nvidia GPUs. In the future this makes bare metal GPUs + Kubernetes the industry standard that AI Natives work the model that enables OpenAI to program directly on Nvidia GPUs will spread. All this human written Cloud Software that optimizes inference performance? OpenAI does their inference stack now using AI to write the code. In 2-3 years, this will be the big disruption as Nvidia's deep investment in tooling will allow it extend it's moat to the AI Cloud layer.