Jev 用类型化问题替代 LLM 决策调用
视频介绍 TypeSafe 的 Jev：不做文本生成，一次调用返回校准概率，在四类决策流程上比 LLM 调用快 193.6 倍、便宜 444.6 倍。
🚨holy f*ck, this broke my brain. Jev replaces every LLM decision call for $0.042 per million. Output is free. Diogo Almeida built it at TypeSafe. No text generation. The model takes typed questions and returns calibrated probabilities in one call. Jev against LLM calls on four decision workflows: 193.6x faster, 444.6x cheaper, upper bound. The worked example on the home page clocks 75x and 171x. SPLIT - no KV cache, no long transcript, typed questions in parallel SCORE - choice, yes/no, probability answered at once in one call GATE - guardrail scores a shell command before the harness runs it One long transcript is the tax. The split pipeline runs below ↓
这条是引用着另一条写的：x.com/6aw0ron0k/status/2114358843685609544