Grep 用 Jev 给 agent 决策输出概率和置信度
Grep 新功能:agent 用前沿模型做调研,再把结论交给 Jev 按预设标准做最终决策,输出每个选项的概率和校准过的置信度,超过阈值自动执行,否则转人工。
Every day this week, we're launching a new feature @GrepdotAI to help you automate the work that's slowing down your business. 𝗗𝗮𝘆 𝟮: 𝗗𝗲𝗰𝗶𝘀𝗶𝗼𝗻 𝗼𝘂𝘁𝗽𝘂𝘁𝘀 𝗽𝗼𝘄𝗲𝗿𝗲𝗱 𝗯𝘆 𝗝𝗲𝘃 Customers often ask why our agents don't attach confidence levels to their recommendations. My answer has been that LLM confidence levels don't mean much. The model writes a number after the answer, predicting what a confident-sounding score looks like, with a bias toward making humans happy. RLHF pushes models overconfident. Decision models like Jev by @typesafeai change that. You declare the options up front. Jev returns a probability for each one in a single pass, plus a confidence score derived from how concentrated that distribution is. TypeSafe trained it with RLCD, which rewards calibration instead of rater approval, so decisions at 0.9 should be right about 90% of the time. In Grep, you can now build agents that use frontier models for the research and diligence, then hand their findings to Jev to make the final decision against your criteria. You set the threshold: above it the agent acts, below it a human reviews.