Questioning Jev's no-hallucination claim as a harness guarantee
The author argues Jev's schema safety comes from the inference algorithm, such as a classification model or parallel constrained decoding, and that guided libraries like outlines can enforce schemas on autoregressive models too.
My issue really is them claiming "no-hallucination" coz of the schema safety. Even Autoregressive LLMs can guarantee schema using low-level guidance libraries like outlines. Since JEV is a classification model, or a parallel constraiend decoder - the schema guarantee is largely a inferencing algorithm. Its NOT the capability of the underlying model, but the harness around it.
To be clear, it makes total sense in a network architecture sense. JEV is a language model. Token representations depend on the input state, and TypeSafe team is likely packing the full list of choices as a list of options into the prompt... So choice order changes probabilities.