Jev monitors agent actions at 126x lower cost
For the same agent action review task, frontier LLMs cost $372 while Jev cost $2.94, because Jev only outputs a probability per option instead of free text.
monitoring ai agent actions with frontier llms cost $372. a classifier called jev did it for $2.94. i read that twice. 126x cheaper, and the big models look absurdly overpriced next to it. the reason is what jev is allowed to output. agent action → jev → probability per option → block / flag / allow → $2.94 bill → every agent action gets checked against its assigned task → you write the options, up to 255 per question. typesafe's jev returns a probability for each → confident it's a problem, blocked. uncertain goes to a human, the rest pass → list price is $0.042 per million input tokens, output free → the bill is under 1% of the llm one. a dollar check there costs under a cent here → the $372 that paid for one run covers 126 runs → openai showed its own version at devday on sept 29, on its small luna model. limited preview, no pricing one caveat. both prices come from one querystory demo, workload size not stated. jev's output is one score per option you wrote. it never writes an answer. watch one action go through the gate ↓
This post quotes another post: x.com/ridark_eth/status/2084625062749958537