WHAT NEW IN X11.05 THU

X 上的 AI 合集档案 · 22 个合集 · 67,905 条

gpt-6IMAGE

具身智能晚餐会:Astra 的上下文学习与记忆之争

Palo Alto 机器人晚餐会上讨论:GPT-6 Astra 零样本抓取成绩亮眼,但接触密集任务仍只有 10%,真正瓶颈是「连续性」而非策略。

Junfan Zhu 朱俊帆 ✈️ IROS
@junfanzhu982026.09.20收录原推发布于 2026.09.19
具身智能晚餐会:Astra 的上下文学习与记忆之争(第 1 张,共 4 张)
具身智能晚餐会:Astra 的上下文学习与记忆之争(第 2 张,共 4 张)
具身智能晚餐会:Astra 的上下文学习与记忆之争(第 3 张,共 4 张)
具身智能晚餐会:Astra 的上下文学习与记忆之争(第 4 张,共 4 张)
Junfan Zhu 朱俊帆 ✈️ IROS @junfanzhu98原推发布于 2026.09.19
在 X 上打开原推

Physical intelligence is no longer just a policy problem. It’s increasingly a continuity problem. Tonight at @shawnshenjx & @memories_ai Physical Intelligence dinner in Palo Alto, that was the argument that survived. @OpenAI GPT-6 Astra has put up striking zero-shot numbers on the less contact-intensive side of embodiment: 70% on a MolmoSpaces subset vs. 53% for Cosmos3, 95% block-to-bowl on real YAM arms, 98% on a RoboLab subset. Yet contact-rich precision remains a wall: 10% on the puzzle-in-groove task. The more interesting jump is in-context learning. In one recent robot-learning study, human-video context takes Astra’s red-towel task progress from 55% to 100%; in that study’s repeated trials it succeeds 2/3 with the video in window. That is not a skill written into weights. The context changed what it could do now. A million-token context window is a rented past, not a hippocampus. A model that can paint the Golden Gate with a robot arm can still be a goldfish. The painting improved because the attempts never left context. @Figure_robot #Helix2.5 shows the collective past transferring as weights: Index pretraining moves zero-shot success from 9% to 56% across 30 unseen homes. @physical_int’s MEM and @memories_ai’s visual memory layer push the other side — how an embodied system keeps experience after the episode ends. Memory without in-context learning is just storage. Weights → what the robot knows. Memory → what the robot remembers. Context → what it can use now. Policy → what it does next. Astra may have pushed in-context planning into the foundation-model layer. It didn’t solve continuity. The next bottleneck may not be another foundation model. It may be compiling a robot’s accumulated experience into the right context at the right moment — without retraining. Generalist robots don’t just need an autobiography. They need to learn from it in context. Actuation is commoditizing. Memory is not. Context is the interface. @aurorafeng_01, @AndrewDai, @HongweiYi2

x.com/junfanzhu98/status/2101207133085679842采集于 2026.09.20 10:11