WHAT NEW IN X11.06 FRI

X 上的 AI 合集档案 · 23 个合集 · 69,849 条

jevIMAGE

Jev 被质疑只是分类器,benchmark 输给 bge-small

从业者指出 Jev 本质是固定选项分类器,banking77 上 83.2% 不敌 bge-small 加逻辑回归的 93.3%,「不会幻觉」只保证格式合法。

Pukerainbow 🤮🌈
@pukerrainbrow2026.09.27收录原推发布于 2026.09.26
Jev 被质疑只是分类器,benchmark 输给 bge-small
Pukerainbow 🤮🌈 @pukerrainbrow原推发布于 2026.09.26
在 X 上打开原推

Jev is getting called out hard by people who actually work in this space the pushback boils down to this. jev isn't a new kind of ai. it's a classifier, returning probabilities over a fixed set of choices instead of generating text. zero-shot classifiers have existed since 2019, hugging face made this basically one line of code years ago the "can't hallucinate" claim is the part getting picked apart the most. typesafe's own docs admit that number isn't measured, what they actually guarantee is the output matches the allowed format. that stops an invalid answer, not a wrong one. those are very different guarantees someone ran an actual head to head on a real benchmark. a simple bge-small embedding model plus logistic regression scored 93.3% on banking77. jev scored 83.2%, and the simple setup ran locally in about 9 milliseconds but not everyone's dismissing it either. one data scientist said the speed and price point genuinely unlocks stuff that wasn't feasible before, like reranking search results in real time as a page loads, since running a full llm for that used to be too expensive and the fair counterpoint keeps coming up too. if this is really nothing new, why is there no open competitor matching it yet so maybe it's not a new category of ai. maybe it's just really good engineering wrapped in a name that makes it sound bigger than it is

x.com/pukerrainbrow/status/2103758223602008538采集于 2026.09.27 10:11