gpt-6VIDEO

Hackathon test: GPT-6 Astra fails NIST gear-on-peg assembly

A team used GPT-6 Astra zero-shot for the NIST gear assembly task at a hackathon; the gear never aligned with the peg, though they documented how frontier models handle real robotic manipulation.

Pratham Jain

@PrathamJainAIArchived 12 days agoOriginally posted 2026.10.18

Pratham Jain @PrathamJainAIOriginally posted 2026.10.18

Open original on X

Our team decided to use GPT-6 Astra at a hackathon to tackle the NIST gear assembly task. The only issue? We couldn’t get the gear aligned with the peg. Although we didn’t win, the experience was fascinating. We got to explore how frontier models perform on real-world robotic manipulation tasks, straight out of the box, without expert demonstrations. Getting a robot to reason is one thing. Getting it to align a gear with a peg is another. A fascinating problem to keep working on. 🤖 For robot eval we used @robocurve Inspect-robots .

x.com/prathamjainai/status/2111680288787239105Archived 2026.10.18 16:03