LangSmith 用 Jev 做 agent trace 在线监控
LangSmith 把 Jev 列为 trace 在线监控的模型选项之一，配合聚类、错误转 eval 等工具帮团队读懂 agent 运行数据。
yup, spot on! Traces are the biggest asset for teams to improve their agents over time with Evals, Environments, & human digestible reports explaining what users want with LangSmith we obsess over tooling to help every team understand their agent traces at scale - online monitoring of every trace (custom models, Jev, super cheap small models, built-in rubrics) - clustering traces and errors into human digestible views - turning errors into evals that can be hill-climbed - and open sourcing tooling to build Harbor Environments for Evals or RL from your data we’re very “look at the data” pilled, there’s alpha hiding in there and we want to help you find it more coming soon on helping every team use their valuable Trace data for post-training 👀
这条是引用着另一条写的：x.com/ypatil125/status/2102883274234494978