WHAT NEW IN X11.06 FRI

AI collections from X · 23 collections · 70,478 posts

jevPOST

Neosigma uses Jev as an agent trace verifier

Across 10,000 verifier decisions, Jev was 6.2x cheaper and 34x faster than GPT-5 Mini, with 88% agreement with human labels.

Ritvik Kapila
@ritvikkapilaArchived 2026.09.27Originally posted 2026.09.27
Ritvik Kapila @ritvikkapilaOriginally posted 2026.09.27
Open original on X

The cost of verification sets a ceiling on how much agents can learn from production. When you can only afford to evaluate a small sample, most of that experience goes unused. Cheap, fast verification raises that ceiling: more failures discovered, more representative evals, and more feedback to improve the model and harness. At @neosigma_ai, our work with Jev makes us optimistic about a future where learning from production is a continuous part of how agents operate. Across 10,000 verifier decisions, Jev was 6.2× cheaper and 34× faster at median latency than GPT-5 Mini, with 88% versus 85% agreement with human labels in a blinded 100-trace audit. full blog here - https://neosigma.ai/blog/verifying-agent-traces-at-scale-with-jev

This post quotes another post: x.com/gauri__gupta/status/2103907582977147113

x.com/ritvikkapila/status/2103910272369078776Archived 2026.09.27 10:12