Gemini 4 Argon runs a Video-to-Sim-to-Real robotics pipeline
A Google blog post shows Argon watching a human play cornhole, building a MuJoCo simulation on its own, and transferring the skill to an Apollo humanoid that sank seven straight shots.
Gemini 4 Argon is here! 🔥 It opens up a new frontier of intelligence for physical AI, including understanding, simulating, and learning complex, real-world physical tasks that matter for robotics 🦾 . Here’s an example of how: 🎥 Argon watched a raw video of a human playing cornhole 🦾 It mapped the spatial coordinates of the environment, and calculated the required whole-body joint movements. 💻 It autonomously built the simulation code with MuJoCo, and then it practice in real 🎯 When transferred onto @Apptronik’s Apollo humanoid, the robot quickly sank seven consecutive shots in a real-world trial 🤯 . This "Video-to-Sim-to-Real" pipeline compresses weeks of manual modeling into a few hours and is a step change across physical AI. Learn more to prompt your robot at: https://developers.googleblog.com/gemini-4-argon-for-robotics/
This post quotes another post: “Gemini 4 Argon learns from video to teach Apollo robot 7 straight cornhole throws”