Embodied First Exam: Gemini 4 Argon and Opus 5.5 solve tasks GPT-6 Astra fails
On the Embodied First Exam leaderboard topping out at 33%, GPT-6 Astra solves only about a third of standard tests while Claude Opus 5.5 and Gemini 4 Argon each solve dozens that Astra fails.
Where we are: 33% on the core leaderboard Leaderboard: http://embodied-first-exam.ai/leaderboard Report: https://www.embodied-first-exam.ai/blogs/ Lessons: 1. Privileged ≠ Standard Most tasks agents solve with full simulator access fail when rerun under real-robot rules (camera only, no resets). Standard mode is far from solved, and no single agent covers it. GPT-6 Astra, the strongest agent, solves only about a third of standard and standard-realtime tests. Claude Opus 5.5 and Gemini 4 Argon each solve dozens of standard tests that Astra fails. 2. Where today's agents break Dexterity and tool use, dynamic control and balance, and long-horizon chores. Even with privileged access, GPT-6 Astra took 40 minutes to drive one bolt on IKEA Stegesund and ran out of time on the second. 3. Where today's agents shine They do best when motion can be planned in advance, resets allow free retries, or the rules are spelled out. Opus worked out a toss-and-recatch with the Jacobian before moving. Astra wrote its own C++ brush renderer to paint calligraphy and passed on its first execution. 4. Agents change strategy with the setting. They write programs in privileged mode, steer step by step in standard mode, and run closed-loop controllers in realtime. In a badminton match, Opus's background program tracked the shuttlecock with a drag model and came back from 7–10 down to win 12–10.