Proposal for a browser-native Jev primitive called decide
The author proposes building a "Nano" Jev into the browser as a JS primitive called decide, which works like switch but runs natural language judgments without a third-party API.
You know what would be truly disruptive? A "Nano" Jev built directly into the browser as a JS method (which naturally means open weight by default). Google Chrome already supports on-device LLM via Gemini Nano and the LanguageModel API, but this "Nano Jev" idea would be much more disruptive. LLMs produce an unknown length sequential output, so streaming is necessary for acceptable UX. But Jev produces a small predetermined output space in parallel, meaning the latency is way more deterministic and predictable, therefore the entire inference can be implemented as a single clause. Here I'm introducing a new primitive "decide", which looks exactly like "switch" but the closure is async and you can call async methods in them. Imagine being able to just use natural language queries instead of switch, WITHOUT relying on a 3rd party API.