WHAT NEW IN X10.28 WED

X 上的 AI 合集档案 · 22 个合集 · 58,924 条

gpt-6IMAGE

用 GPT-6 Astra 驱动双臂在 Godot 模拟中缝合血管

作者主张机器人应做 LLM 的「身体代理」:模型看摄像头画面、拆解任务、用工具调用控制机械臂,并举例有人让 GPT-6 Astra 在 Godot 模拟里完成双臂血管缝合。

Steven Cheng
@stevencheng2 天前收录原推发布于 2026.10.26
用 GPT-6 Astra 驱动双臂在 Godot 模拟中缝合血管
Steven Cheng @stevencheng原推发布于 2026.10.26
在 X 上打开原推

Robotics is turning into the physical agent for LLMs. For the last few years, embodied AI has mostly been about getting robots to learn moves on their own. Train with RL over and over. Collect teleop data to train VLAs. Chase general-purpose humanoids with dexterous hands. What you get: pricey data, a zoo of incompatible hardware, and slow progress. There's another path that's starting to actually work: don't make the robot think. Let the LLM do the thinking. The model looks at the camera feed, figures out the task, breaks it into steps, then uses tool calls to hit the arm's "move", "grip" and "release". Picture a really smart kid with a game controller, staring at a screen, driving a robot arm. Someone just had GPT-6 Astra run two arms through vessel suturing in a sim built in Godot, a game engine. It's just a sim, nowhere near real surgery. But it shows something: LLMs are getting good enough at spatial reasoning and long-horizon planning to start calling the shots in the physical world. So here's how the work splits up: 🧠 Brain: LLM / VLM. Thinks every few seconds. Decides what to do. 🦴 Cerebellum and spine: motion planning, low-level control, safety. Reacts in milliseconds. Figures out how to move without crashing into stuff. My little propeller balancing toy has to tweak its PWM every 10 ms or the stick just falls over. One LLM tool call takes a few seconds. Doesn't matter how smart the brain is, it can't do the cerebellum's job. But the "what to do" part? That's going to the models, more and more. So what does this mean for robotics companies? An agent is basically a reseller. Robots are going to be the LLMs' resellers in the physical world. Better models make robots more useful, sure. But more of the value keeps flowing upstream to OpenAI, Anthropic and Google. The robotics companies that make it will look like the resellers that make it. Two kinds: • The ones that nail the "cerebellum": hardware, control, safety. Stuff the model can't do for you. • The ones that go really deep on one setting: the workflows, data and customers of a specific factory, lab or warehouse. If you're just a middle layer, upstream will squeeze you sooner or later. LLMs won't replace robotics. Robotics will become their hands and feet. Inspired by @lidangzzz's ideas and @maoconsult511's experiment. Thanks, both.

x.com/stevencheng/status/2114392934594523549采集于 2026.10.26 10:10