Jev 在 Helix 旅行意图路由上的实测数据
旅行 AI 团队用 Jev 跑数百条真实用户消息评测：准确率追平现有小模型，单次决策约 0.25 秒（快约 4 倍），成本更低，置信度 0.8+ 时正确率 96–100%。
Congrats @typesafeai team... tested Jev on some @HeyHelixAI core routing functions (for example "Is this a flight / hotel / restaurant / experience request?") against 100s of evals. Early test results: - Accuracy on par with, or slightly ahead of, the (already small, fast, cheap) LLMs we use today, on real user messages the models had never seen ✅ - Roughly 4x faster: about a quarter of a second per decision, versus 1 to 1.7 seconds (note some of this was network latency from Europe - US) ⚡ - A fraction of the cost per call 💷 - Confidence that means something: when it said it was confident (0.8+), it was right 96 to 100% of the time 🎯 - Matching remembered traveller preferences to hotels ("does this hotel have what I like?"): it found 97.6% of real matches, with zero false positives 🏨 Headline image from https://typesafe.ai - go check it out