Robot video benchmarks: Gemini 4 Argon scores 49.6 on annotation, behind nanoannot-1
On the new MicroAnnotationBench, in-house nanoannot-1 leads at 54.8 while Gemini 4 Argon scores 49.6 at 10x the cost; GPT-6 Astra tops the next-action MicroPlanBench.
Today we’re releasing two benchmarks for robot learning from egocentric video. MicroPlanBench: can a model predict the next action? GPT-6 Astra leads but still misses 1 in 3. GPT-6.1 Sol is essentially tied at about 1/5 the cost. MicroAnnotationBench: can a model label long clips of real work, with exact timing? Our nanoannot-1 scores 54.8, ahead of every frontier model we tested. The best, Gemini 4 Argon, scores 49.6 at 10x the cost. One takeaway: knowing what happens isn’t knowing when. The GPT models top next-action prediction, but on minute-long clips they cut 50%+ more segments than human annotators and miss most boundaries. Timing is its own skill. Links below.