jevIMAGE

Jev ranking tip: use Choice pairwise comparisons instead of Score

When ranking relevance in Jev, the author suggests using Choice for pairwise comparisons and aggregating with something like Bradley-Terry instead of asking for a Score and sorting on it.

Nathan LeClaire

@dotpemArchived 18 days agoOriginally posted 2026.10.12

Jev ranking tip: use Choice pairwise comparisons instead of Score

Nathan LeClaire @dotpemOriginally posted 2026.10.12

Open original on X

here's a jev tip. when ranking, it's tempting to ask for a Score, like "Is this content relevant to <xyz>?" and then sort on it. but it seems better to use a Choice instead, doing pairwise comparisons ("Which is the most relevant?") and using something like Bradley-Terry.

x.com/dotpem/status/2109474543249264878Archived 2026.10.13 10:09