GPT-6 Astra edits unrelated code, so one user plans with it and executes with Sol
A user asked Astra to improve a landing page's Lighthouse score, but it renamed a docs nav label and added an unrequested dark theme; planning feels more nuanced, but it means more code to review.
GPT 6 Astra (Max) went to change things not related to the task I gave it at all and not once. I asked it to improve my landing page Lighthouse score, but it went and changed a documentation navigation label from “Go” to “Go SDK” 😆 What is that? Why? Or started to add support of a dark theme, I didn't ask and don't plan to do it. And a few more like that. It adds me more code to review. However, it does feel more nuanced in planning and reasoning. Currently, seems for me to stay productive it is better to plan and resolve complex issues with Astra, but execute with Sol.