jevPOST
7B local model prompt-based routing tested against Jev
Someone compared a token-saving routing approach that makes the LLM return only 1/0 or a confidence score with Jev on speed and results across several use cases.
Tinyfool
@tinyfoolArchived 2026.09.22Originally posted 2026.09.21
Tinyfool @tinyfoolOriginally posted 2026.09.21
RT @zhufengme: 测了下 Jev。其实之前我们就在尝试用大模型做决策和分流:给模型上下文,只要求返回 1、0 或一个置信度数字,目的就是尽量省 Token。昨天又拿 7B 模型在本地跑了下,用提示词约束 LLM 只返回决策结果,再和 Jev 对比。几个用例下来,速度…
x.com/tinyfool/status/2101860914152824874Archived 2026.09.22 10:31