Jev hits 88.7% accuracy on 532 customer service agent evals

Malte Kosub @maltekosubOriginally posted 2026.09.22

Open original on X

Interesting directional result from our eval work: We tested JEV against 13 models on 532 real world CX agent evaluations. JEV: 88.7% accuracy Next best: 79.5% Still early, but a strong first signal. If this holds up at scale, specialized decision models could become the default for a huge part of agent evals, with dramatically better economics and latency.