jevPOST
通宵跑 Jev 基准:成本、延迟与注入拦截
500+ 次 API 调用只花 0.03 美元,成功拦截自训 agent 内核上的伪造审批注入,但错误答案上置信度仍报 1.00。
Observer
@0bserver2026.09.18收录原推发布于 2026.09.17
Observer @0bserver原推发布于 2026.09.17
Spent the night benchmarking Jev from @typesafeai. Ups: 20 extra questions cost +47ms; 500+ api calls, barely spent 0.03 $ It caught a fake-approval injection on my own fine-tuned agent kernel. I'd say %98 success rate (spent so much time with jev lol) Downs: it reported confidence 1.00 on a wrong answer, so no, you can't gate on it. YET. However, I'm impressed for a v1! Congrats @CompleteSkeptic and the team
x.com/0bserver/status/2100395569889906793采集于 2026.09.18 10:16