Adding a dedup cache with Jev cuts repeated agent calls
A trading agent runs about 10,000 checks a night, and many repeated questions are caught by Jev's cheap layer or escalated, so Claude only wakes up for genuinely new state.
I was paying for the same answer 40 times a night. Same question, same yes, billed every single time. And that's just one repeat. Across a night my agent runs ~10,000 checks - a big share of them are things it already answered. Here's the leak nobody checks. Your agent asks the expensive model the same thing over and over — "is this wallet safe?", "is this still valid?" — and every repeat is a fresh $0.018 call. Same input, same output, full price, forever. So I gave the cheap layer a memory: JEV → answers skip or escalate. $0.042 per million tokens, output free. DEDUP → sees a question it already answered with the state unchanged, returns the saved answer. No model, no charge. The moment the state changes, it's a new call and Claude wakes up. CLAUDE → only runs for something it's actually never seen. Same 10,000 checks. The repeats stopped costing anything. The expensive model went from answering everything to answering only what's new. One cheap memory in front of an expensive brain.
This post quotes another post: x.com/kinderlayer/status/2104901484991131774