EFE 机器人基准发布:GPT-6 Astra 等 agent 系统统一评测
社区联合发布 Embodied First Exam,覆盖 1000+ 任务、30+ 机器人基准、44 个平台,用来系统评测 GPT、Claude、Gemini、DeepSeek、GLM 上的 agent。
Can GPT-6 Astra solve today’s robotics tasks? You’ve probably seen plenty of one-off case studies since Astra’s release. We wanted a systematic answer. Through a joint community effort, we’re releasing the Embodied First Exam (EFE): a comprehensive framework for benchmarking agentic systems on robotics tasks. EFE spans 1000+ tasks, 30+ robotics benchmarks, and 44 robot platforms, with multiple evaluation modes. We evaluate agents built on GPT, Claude, Gemini, DeepSeek, and GLM. Like many others, I’m truly impressed by what these agentic systems can do. For the first time, I think we might be close to a GPT moment for robotics. Leaderboard: https://www.embodied-first-exam.ai/leaderboard/ Follow-up studies and blog posts coming soon. Stay tuned!
这条是引用着另一条写的:「Embodied First Exam:1090 个具身任务评测基准上线」