Jev 当裁判 vs LLM 当裁判：100 条 agent 轨迹实测

Simplifying AI @simplifyinAI原推发布于 2026.10.20

在 X 上打开原推

Jev as a judge vs. LLM as a judge: Same 100 agent trajectories. Two evaluators. - Jev: 13.5 seconds, $0.001912 - GPT-5.5: 120.8 seconds, $0.419130 Jev was roughly 9× faster and 219× cheaper in this run. A general-purpose LLM generates its judgment token by token. Jev returns focused, typed judgments and probabilities against defined criteria. The video shows the comparison live, with a score for every trajectory. For another way to use Jev, the guide below walks through pairing it with Opus to cut token usage by 90%.

这条是引用着另一条写的：x.com/simplifyinai/status/2112082277165568335