用 Jev 自动聚类 RL 训练中的失败模式

Bryan Lee @_brylee10原推发布于 2026.09.24

在 X 上打开原推

I implemented a system in @appliedcompute’s platform for automated failure mode clustering with Jev to surface errors at an even larger scale than before. RL training produces billions of tokens in traces. I always manually read many traces to understand model behavior, but finding agent failures (like reward hacking / hallucinations) at scale is easy to miss without automation. Here’s how it works: