WHAT NEW IN X10.29 THU

AI collections from X · 22 collections · 58,925 posts

gpt-6POST

Vulnerability hunting test: GPT-6 Sol vs GPT-5.6 Sol behavior

A tester says GPT-6 Sol tends to close out a single provable finding while GPT-5.6 Sol keeps probing edge cases, and claims astra=sol and sol=terra are rebadges.

BradMoon
@xy9301Archived 2026.09.24Originally posted 2026.09.23
BradMoon @xy9301Originally posted 2026.09.23
Open original on X

When hunting for vulnerabilities, GPT-6 Sol tends to focus on validating and wrapping up a single provable finding, while GPT-5.6 Sol is more willing to keep asking, “What else could go wrong in this same code?” In this round of testing, that made 5.6 Sol more likely to uncover bugs hiding in edge cases. But the sample was tiny, so this is only a tendency observed in this round. Cost down 60%, time down 30%, input down 15%, output down 30%, the same direction as the DeepSeek v4.1 update. Essentially, astra = sol, sol = terra. OpenAI makes you think you’re using Sol, but you’re not.

x.com/xy9301/status/2102614641725559037Archived 2026.09.24 10:06