Sol vs Astra on a robot-drawing benchmark, tested

Dmytro Hrybov @dimentaryOriginally posted 2026.09.23

Open original on X

compared GPT-6 Sol and Astra on my "robot drawing on the board" bench Sol used ~25k output tokens vs ~22k for Astra. interestingly, Sol's controller drew twice as fast to be honest, i expected stronger spatial reasoning from new Sol here, but it was way cheaper to run (almost 5x)