WHAT NEW IN X11.04 WED

AI collections from X · 22 collections · 67,905 posts

jevVIDEO

Coder One: a Jev-based System One coding agent benchmarked against Claude Code

OpenAgents built a coding agent harness with Jev and compared it to Opus 5.5 in Claude Code on TerminalBench v4; early results show similar success rates at roughly 45% lower cost, with code and report fully open-sourced.

OpenAgents
@OpenAgentsIncArchived 2026.09.24Originally posted 2026.09.23
Coder One: a Jev-based System One coding agent benchmarked against Claude Code
OpenAgents @OpenAgentsIncOriginally posted 2026.09.23
Open original on X

Episode 287: Building a System One Coding Agent We build Coder One, a coding agent harness with first-class support for System One via Jev from @typesafeai. We benchmark Coder One against Opus 5.5 in Claude Code using TerminalBench v4. The full run is still ongoing, but the early results are very promising (~45% cheaper for ~same success rate). We'll let Opus 5.5 summarize them in the picture below 👇 and full report here: https://github.com/OpenAgentsInc/openagents/blob/main/docs/terminal-bench/2026-09-23-coder-one-vs-claude-code-tb4.md All our harness+benchmark code are 100% open-source: https://github.com/OpenAgentsInc/openagents Hazarding a prediction if these results hold: All coding agent harnesses from the closed labs will no longer make sense to use as separate products, only constrained and orchestrated by a System One-centric harness like Coder One. "Claude Code, we're here to eat your f*cking lunch." Stay tuned for the full benchmark. -- One more fun analysis from Opus 5.5 @ 2:33:00: "- No single lab can be the router. A lab's harness routes to its own models. The best policy we found already mixes labs: Luna on some tasks, Opus on others. A router that works across labs is structurally something only a neutral party can build. - The layer on top of the lab harness pays. Jev plus our opinionated front end put in front of Claude Code kept the pass rate (24/24) and cut cost 61% and time 37%. The biggest measured headroom is choosing a configuration per task: about 7 cents against $1.09 on the same tasks. - Open, shared optimization is a real differentiator. Labs and closed router companies keep what they learn about routing and tuning. With NIP-OPT, an optimization is a signed, pinned record with its evidence: which configuration won, on which workload, measured how. Everyone can reuse and check it. If contributions accumulate, each operator's runs make every other operator's Coder better. That's a network effect no single lab can match, because no lab will share its competitors' results." NETWORK EFFECT IS BACK, BABY SEE YOU SOON

This post quotes another post: “Podcast: Jev and the System One approach to coding agents”

x.com/openagentsinc/status/2102773483109335209Archived 2026.09.24 10:19