实测：Jev 重排比 LLM 便宜 50 倍但质量更差

Trevin Chow @trevin原推发布于 2026.09.22

在 X 上打开原推

Most Jev demos get shared in a vacuum, focused on cost and speed. But mysteriously absent is any discussion about comparative quality against an LLM driving for the same outcome. Yesterday I ran Jev in a re-ranking pipeline with an eval harness. It was ~50× cheaper and ~25× faster than the LLM path. We still kept Opus. Why? Opus produced better results on that task. We’ll pay more money and more time when the ranking is better. That shouldn’t be controversial — you just never hear it next to the flashy Jev demos. The interesting part of Jev isn’t “replace your LLM.” It’s the new loops you can afford when a decision is insanely cheap, and insanely fast.