Building a Jev-style classifier by hand with gpt-4.1 logprobs

Tim Becker @tjbeckerOriginally posted 2026.09.22

Open original on X

We had Jev before it was cool. We wanted fast and cheap classifiers for several tasks, so we wrote generic classifier code. It sampled a single token from gpt-4.1 and used logprobs to assign probabilities to each option. https://github.com/theori-io/aixcc-afc-archive/blob/main/crs/agents/classifier.py