WHAT NEW IN X11.03 TUE

X 上的 AI 合集档案 · 22 个合集 · 66,612 条

jevPOST

Jev 在 agent 评测中对比 GPT-5.6 与 Sonnet 4.6

新评测称 Jev 500/500 二元决策与人类一致,方差比 GPT-5.6 Terra 低 913 倍,单次 0.44 秒、0.00035 美元。

Dami-Defi
@DamiDefi2026.09.23收录原推发布于 2026.09.22
Dami-Defi @DamiDefi原推发布于 2026.09.22
在 X 上打开原推

Are you guys even paying attention? 913× lower score variance. That's what Jev recorded versus GPT-5.6 Terra in a new agent evaluation test. Jev was tested against GPT-5.6 Luna, Terra and Claude Sonnet 4.6 and delivered: → 500/500 binary decisions matched the human oracle → 92–913× lower variance → 0.44s average latency → $0.00035 per call Why it matters: Traditional code evals are rigid. LLM judges can be expensive, slow and inconsistent. Jev takes a different approach: structured decisions instead of generated text. That could make continuous, large-scale agent evaluation dramatically cheaper. The bigger unlock isn't just better agents. It's being able to test them constantly.

这条是引用着另一条写的:「LangChain 实测 Jev 对比 LLM 评审」

x.com/damidefi/status/2102364034423234631采集于 2026.09.23 10:17