Jev 把 agent 的分支决策压成类型化选择
观点帖:agent 每次选分支都调大模型太浪费,Jev 用类型化 Choice 加概率替代,官方称 $0.042/百万输入 token、70–500ms。
JEV COULD MAKE A $10,000/MONTH AI AGENT LOOK LIKE A FUCKING YES/NO BUTTON. Picture this: your agent opens a giant chat model every time it needs to pick a branch. Is this source relevant? Which team gets this ticket? Does a human need to review this result? Another model call. Then another. Then another. Not to write code. Not to solve the problem. To choose a fucking label. That is the habit Jev is coming for. TypeSafe built it for bounded decisions: define the state and possible answers, then get back a typed choice with a probability. Its published price is $0.042 per million input tokens; it reports 70–500 ms end to end. Those are TypeSafe's numbers, not a test I ran. This isn't “GPT is dead.” You still need a general model for writing, synthesis, and open-ended reasoning. But imagine a workflow asking the same tiny question ten thousand times. Why drag an entire conversation into every fork? The next useful AI model might not write a better answer. It might make half your prompts disappear.
这条是引用着另一条写的:x.com/fluixoo/status/2101672915984888306