jevPOST
Labeling open-source repo issues with open-source Jev (semif)
The author uses semif, an open-source Jev-like tool, to label incoming issues by passing the title and body as state and asking one question per label, applying labels only when p>0.8, which is much faster than their previous LLM classifier.
Sydney Runkle
@sydneyrunkleArchived 2026.09.23Originally posted 2026.09.23
Sydney Runkle @sydneyrunkleOriginally posted 2026.09.23
i'm using semif (like jev, but open source) to label new issues that come into our open source repos so we have a pulse on popular features and areas where we need to spend more time current request model: * state -- issue title/body * questions -- one noul per label, we apply ones w/ p>0.8 much faster than our previous LLM classifier thus far, currently monitoring to make sure we're calibrated at the right threshold
This post quotes another post: x.com/hacubu/status/2102064714851455363
x.com/sydneyrunkle/status/2102519191157068024Archived 2026.09.23 10:14