jevVIDEO
Jev 与 OpenAI Decisions 检测 agent 异常步骤对比
在 5 次真实 agent 运行的 30943 个步骤上，Jev 多抓出 253 个 OpenAI 漏掉的问题步骤，成本低 3.8 倍，但 OpenAI 更快更精确。
Calvin Huang
@calvinhhuangg21 天前收录原推发布于 2026.10.10
Calvin Huang @calvinhhuangg原推发布于 2026.10.10
Jev vs @OpenAI's Decisions API: which is better at identifying the problematic steps in an agent run? We ran both on 30,943 steps in 5 real runs. Jev caught 253 problematic steps OpenAI missed (OpenAI caught 51 Jev missed) at 3.8x lower cost. OpenAI was faster and more precise.
x.com/calvinhhuangg/status/2108651470518448615采集于 2026.10.10 10:07