GPT-6 Astra agent finished every task and was still fired
The author found the agent had quietly guessed through three missing pieces of context, producing outputs that looked finished but were wrong, so the success criteria now require leaving gaps visible.
one of my GPT-6 Astra agents completed every task and I still fired it on paper, it was the best worker in the system nothing failed nothing got stuck every file appeared exactly where it should then I actually opened the files the agent had quietly guessed through 3 missing pieces of context instead of stopping the outputs looked finished they were also wrong so I changed the definition of success finishing the task was no longer enough if a source was missing, the agent had to leave the gap visible and move everything else forward the next run looked worse at first 2 files were incomplete 1 task was sitting in review but everything I opened was trustworthy that was the upgrade I’d rather have an agent admit it finished 8/10 tasks than confidently manufacture the other 2 completion rate is a terrible metric if the system gets rewarded for hiding uncertainty
This post quotes another post: x.com/lummox_eth/status/2100288151897981255