jevIMAGE
Jev decision models join Agent Analytics alongside OpenAI Decisions
The author says agent evals had two lanes, code and LLM judges, and Jev opened a third with decision models, which can be dry-run and then used to score production sessions at scale and chart results against what users did next.
Vinay Goel
@vinaygoArchived 24 days agoOriginally posted 2026.10.08

Vinay Goel @vinaygoOriginally posted 2026.10.08
Agent evals had two lanes: Code and LLM judges. Jev opened a third: decision models. OpenAI just entered it. OpenAI Decisions is now live alongside Jev in Agent Analytics! Dry-run it, then score production sessions at scale and chart the results alongside what users did next.
This post quotes another post: x.com/openaidevs/status/2107573382229188645
x.com/vinaygo/status/2107920920434368784Archived 2026.10.08 10:08