WHAT NEW IN X10.31 SAT

AI collections from X · 22 collections · 61,986 posts

jevPOST

Jev is one of four models in a 16-model test that reliably admit "I don't know"

In a test of 16 models, Jev was one of only four that reliably admitted "I don't know" on ambiguous questions while answering in under a second, which the author says matters for agents knowing when not to answer.

Vaishnavi
@_vmlopsArchived 2026.09.20Originally posted 2026.09.19
Vaishnavi @_vmlopsOriginally posted 2026.09.19
Open original on X

Jev is making a pretty interesting tradeoff 👀 In a test of 16 models, it was one of only four that reliably admitted “I don’t know” on ambiguous questions while staying under a second Fast answers are useful Knowing when not to answer is even more important for AI agents https://t.co/S7e5QLxP8L

x.com/_vmlops/status/2101201953762275350Archived 2026.09.20 11:14