Jev controls a Minecraft player while Astra plans and adds skills
Jev drives WASD, space, clicks and mouse movement while Astra sends instructions asynchronously and adds .mjs skill files after each failure until the agent could speedrun; the code is open sourced.
Harness: I made Jev control the player, has access to WASD, space, click, and mouse movements. Astra is the planner that sends instructions to Jev async. Learning: Each time the agent would fail, Astra would add skills as mjs files, that it can draw upon in different scenarios, until it could successfully speedrun. Next thing to try is to plug into Trajectory and post-train an open source model to learn this behavior. Minecraft details Version: 1.16.5 , seed: 8398967436125155523 , is a common speedrunning seed Full code: https://github.com/rmalde/minecraft-agent
Jev + Astra beats the Ender Dragon in Minecraft in 8 minutes 43 seconds! ⏱️ Cost less than $1 ($0.01 Jev, $0.96 Astra) I open sourced the code and explain the harness setup below. This type of movement is only possible with Jev's near instant decisionmaking, and some continually learning skills from Astra.