GPT-6 Astra 做机器人控制到底行不行:Ditto-Bench 实测
作者烧了大量 token 对比 Astra 与近期 VLA 模型,测试控制接口、失败学习、推理强度和去掉记忆后的表现,代码全开源。
How useful is GPT-6 Astra for robot control, really? 🤔 Lin and I burned plenty of tokens to explore questions: - How does Astra compare with recent VLAs across different tasks? - Which control interfaces work best with Astra (linear motion vs. action chunking)? - Can it learn from its own failures or others' demonstrations? - Does higher reasoning effort (more thinking) improve performance? - What happens when we remove its memory? (Many VLAs have little or no memory) Check Ditto-Bench and our findings in the blog post. Full code included! 👇 https://llong-cs.github.io/llms-for-robot-control/ This was a fun analysis led by Lin, one of my first PhD students at JHU. He joined without much robotics experience but quickly produced a thorough benchmark and thoughtful analysis! 💪
这条是引用着另一条写的:「Ditto-Bench:测试 GPT-6 Astra 在复杂物理机器人控制中的表现」