WHAT NEW IN X11.02 MON

X 上的 AI 合集档案 · 22 个合集 · 64,204 条

jevVIDEO

实测 Jev:不写文本的决策模型,准确率与成本对比

作者逆向测试 Jev,给出四个工作流下与 GPT-5.6 Terra、Claude Opus 5 的准确率、单价和耗时对比,并指出基准自测、无理由输出等未验证点。

st1ne
@SolSt1ne25 天前收录原推发布于 2026.10.06
st1ne @SolSt1ne原推发布于 2026.10.06
在 X 上打开原推

I still can't believe a model this useful never writes text… i spent a day reverse-engineering Jev from the docs and hands-on tests what it does: > you send messy state + typed questions > it returns decisions with calibrated odds > your code routes on the confidence the numbers (TypeSafe's own eval, 4 workflows): → Jev: 67.8% accuracy, $0.0004 per case, 0.4 s → GPT-5.6 Terra: 67.9%, $0.0304, 10.1 s → Claude Opus 5: 73.1%, $0.1761, 37.8 s what's not proven yet: -> the benchmark was written by TypeSafe itself, no independent reproduction -> confidence is calibrated across many calls, not per single answer -> no rationale, so you can't audit why it decided so it's not a Claude replacement it's the layer in front of Claude that decides when Claude is even needed full breakdown on one page ↓

这条是引用着另一条写的:x.com/solst1ne/status/2101724066369654935

x.com/solst1ne/status/2107425319183327476采集于 2026.10.07 09:59