Same prompt run through GPT-6 Sol, Opus 5.5 and two other models
The author tests four models with one news-writing prompt, lists costs and results, and calls Opus 5.5 the best result and GPT-6 Sol the cheapest.
Same prompt, four modes/models: - GPT-6 Sol - Opus 5.5 - High (GPT-6 Astra) - Ultra (Fable 5.1) Here's the prompt: "Look at the last two news posts we published on runner functionality: one runner is now enough, and one runner many worktrees. I now want you to write a news post that's similar but for the functionality behind the `shared-runners` feature flag. It should probably also contain a screenshot of the picker that shows two normal runners and two shared runners, like `gpu-runner` or `macos-builder` or something and some nic elooking avatars and good data. And it should succinctly explain how it works and how people can use it." Costs: - Opus 5.5: $9.54 - GPT-6 Sol: $3.10 (estimated list price, using sub) - High: $7.58 (estimated list price, using sub) - Ultra: $15 Notes: - Ultra took by far the longest, Ultra is the only one that didn't create docs (I didn't say they should create docs but I think the other models looked at previous commits and figured out they should do that?) - Ultra was the only model that didn't prominently display the "give me the grant to upload assets at the end" - I think Opus 5.5 is the best result. It really feels like more creative (headline) and it nailed the screenshots. - High is my second favorite.