WHAT NEW IN X11.03 TUE

X 上的 AI 合集档案 · 22 个合集 · 65,263 条

jevVIDEO

Jev 当裁判 vs LLM 当裁判:100 条 agent 轨迹实测

同样 100 条 agent 轨迹,Jev 用 13.5 秒、0.0019 美元,GPT-5.5 用 120.8 秒、0.419 美元,约快 9 倍、便宜 219 倍,视频展示每条评分。

Daily Dose of Data Science
@DailyDoseOfDS_29 天前收录原推发布于 2026.10.03
Daily Dose of Data Science @DailyDoseOfDS_原推发布于 2026.10.03
在 X 上打开原推

Jev as a judge vs. LLM as a judge: We ran the same 100 agent trajectories through both evaluators. Jev finished in 13.5 seconds and cost $0.001912. GPT-5.5 took 120.8 seconds and cost $0.419130. That made Jev roughly 9x faster and 219x cheaper in this run. The difference comes from the job each model performs. A general-purpose LLM generates a judgment token by token. Jev is built to return focused, typed judgments and probabilities against defined criteria. The video shows the comparison live, including the score returned for every trajectory. We wrote a deeper breakdown of how Jev works as an agent judge, where it fits, and how to build with it. Read it below.

这条是引用着另一条写的:x.com/703601972/status/2102087107410002345

x.com/dailydoseofds_/status/2106315877360795970采集于 2026.10.04 10:05