jevPOST
在 HLE 多选题上实测 Jev 约 19.7%
作者在 AA Decision Index 同款 513 题上复测 Jev,并对比最长答案启发与随机基线。
antoine_chaffin
@antoine_chaffin15 天前收录原推发布于 2026.10.14
antoine_chaffin @antoine_chaffin原推发布于 2026.10.14
On HLE's 513 text-only multiple-choice questions (the set used in the AA Decision Index), I measured Jev at 19.7% (that's a bit below the AA chart's 21: setups differ slightly and its outputs aren't deterministic) On this exact set, always picking the longest answer scores 20.7%, vs 16.4% for random guessing That's above every decision model tested (the effect comes mostly from Math and Physics questions)
x.com/antoine_chaffin/status/2110335916170416189采集于 2026.10.15 10:43