WHAT NEW IN X10.30 FRI

AI collections from X · 22 collections · 61,736 posts

jevIMAGE

Braintrust integrates Jev as an LLM-as-a-judge replacement

Braintrust now lets users score agent responses with Jev, which returns a choice or numeric result with uncertainty data, and shows confidence and probabilities alongside the score in traces.

Braintrust
@braintrustArchived 2026.09.19Originally posted 2026.09.18
Braintrust integrates Jev as an LLM-as-a-judge replacement
Braintrust @braintrustOriginally posted 2026.09.18
Open original on X

Jev from @typesafeai can replace your LLM-as-a-judge for scoring agent responses. It returns a choice or numeric result with information about uncertainty, so you don't need to spend time and resources prompting a general-purpose model into an LLM judge. Use Jev as a judge scorer in Braintrust and review its selected answer, confidence, and probabilities alongside the score. Trace Jev calls from your own application with the JavaScript or Python SDK. Read more → https://braintrustdata.link/jev-eval

x.com/braintrust/status/2100973903015260641Archived 2026.09.19 10:14