用 Jev 把 40 agent 研究系统压到单台笔记本运行
讲 Jev 工程化的核心:把判断从大模型挪到只输出类型(Choice/Score/概率)的小模型,一次并行 40 个问题、半秒内返回,大模型只负责写作。
JEV ENGINEERING TURNS A 40-AGENT RESEARCH SYSTEM INTO SOMETHING THAT RUNS ON A SINGLE LAPTOP Most agent stacks send every judgment back to the language model, so each small decision costs a full call and the bill grows with how careful the system is. The deciding moves out to a tiny model that answers in types instead of sentences, a choice, a score, or the odds something is true. One call carries 40 questions in parallel, scope checks, risk scores, retry ceilings, all landing back in under half a second. The big model stops seeing decisions entirely and only writes, because judging and generating turned out to be two jobs on two different price tiers. Running six projects at once barely moves the cost, since the part that scales is now the cheap part. See how the typed question layer actually works below👇
这条是引用着另一条写的:x.com/0xcodio/status/2104195432209387524