设想用 Jev 做 LLM 工具调用的决策副驾
提出 System One 模型当协调器:LLM 只做 token 预测,Jev 判断何时该发工具调用并注入结果,形成循环。
This could be a nice architecture to explore: Use @typesafe Jev as a tool call coordinator for LLMs. LLMs are now better at tool calling than they were, but it's still an ugly hack in the coding harnesseses. System One models could likely decide better when a LLM needs to perform a tool call to either get more info or to perform an action - like a LLM's decision side-car of sorts. I imagine a kinda "cyber-LLM" loop that a System One model controls: 1. LLM just does token prediction (let's say 1k at a time) 2. System One model decides if the token stream would benefit from one or more tool calls (issues tool calls, injects input+output into the LLM token stream) 3. go to step 1 🤔