Nunu AI releases GameGym gaming benchmark for AI agents
Nunu AI opened parts of its internal evaluation environments as GameGym, measuring frontier models on video games by completion rate and speed.
Introducing GameGym: The ultimate gaming benchmark for AI agents 🎮 Today we're releasing parts of our internal evaluation environments to track frontier model performance on video games. It measures two main KPIs: completion rate and speed. Similar to speedrunning, while completion rates may eventually saturate, speed is designed to be an evergreen metric for continuously measuring improvements. Games are amongst the hardest challenges for AI to master: 3D, real-time, long-horizon, non-deterministic and massively diverse environments. We believe it is the perfect benchmark built for the endgame. Check out early results here: https://evals.nunu.ai/benchmarks/game-gym