jevPOST
Teknium: an LLM restricted to fixed options with logprobs is basically Jev
He argues that constraining an LLM to generate one token from a fixed set of options and using logprobs as a confidence score amounts to hand-building a Jev.
Teknium 🪽
@TekniumArchived 2026.09.21Originally posted 2026.09.21
Teknium 🪽 @TekniumOriginally posted 2026.09.21
@erikdunteman I mean that is what an LLM does - you can even turn an LLM into jev by just letting it generate one token from a fixed set mapping to your options (aka, multiple choice question), and using logprobs for confidence score
x.com/teknium/status/2101812483443114351Archived 2026.09.21 10:13