Jev 当裁判 vs LLM 当裁判:100 条 agent 轨迹实测
同样 100 条 agent 轨迹,Jev 用 13.5 秒、0.0019 美元,GPT-5.5 用 120.8 秒、0.419 美元,约快 9 倍、便宜 219 倍,视频展示每条评分。
Jev as a judge vs. LLM as a judge: We ran the same 100 agent trajectories through both evaluators. Jev finished in 13.5 seconds and cost $0.001912. GPT-5.5 took 120.8 seconds and cost $0.419130. That made Jev roughly 9x faster and 219x cheaper in this run. The difference comes from the job each model performs. A general-purpose LLM generates a judgment token by token. Jev is built to return focused, typed judgments and probabilities against defined criteria. The video shows the comparison live, including the score returned for every trajectory. We wrote a deeper breakdown of how Jev works as an agent judge, where it fits, and how to build with it. Read it below.
这条是引用着另一条写的:x.com/703601972/status/2102087107410002345