具身智能首考榜:Gemini 4 Argon 与 Opus 5.5 补位 Astra 短板
Embodied First Exam 核心榜最高仅 33%,GPT-6 Astra 只解出约三分之一标准测试,Claude Opus 5.5 与 Gemini 4 Argon 各自解出数十道 Astra 失败的标准题。
Where we are: 33% on the core leaderboard Leaderboard: http://embodied-first-exam.ai/leaderboard Report: https://www.embodied-first-exam.ai/blogs/ Lessons: 1. Privileged ≠ Standard Most tasks agents solve with full simulator access fail when rerun under real-robot rules (camera only, no resets). Standard mode is far from solved, and no single agent covers it. GPT-6 Astra, the strongest agent, solves only about a third of standard and standard-realtime tests. Claude Opus 5.5 and Gemini 4 Argon each solve dozens of standard tests that Astra fails. 2. Where today's agents break Dexterity and tool use, dynamic control and balance, and long-horizon chores. Even with privileged access, GPT-6 Astra took 40 minutes to drive one bolt on IKEA Stegesund and ran out of time on the second. 3. Where today's agents shine They do best when motion can be planned in advance, resets allow free retries, or the rules are spelled out. Opus worked out a toss-and-recatch with the Jacobian before moving. Astra wrote its own C++ brush renderer to paint calligraphy and passed on its first execution. 4. Agents change strategy with the setting. They write programs in privileged mode, steer step by step in standard mode, and run closed-loop controllers in realtime. In a badminton match, Opus's background program tracked the shuttlecock with a drag model and came back from 7–10 down to win 12–10.