Invoice pipeline: Jev sorts inbox perfectly, but a 4B fine-tune wins on payment decisions

Jacek Golebiowski @j_golebiowskiOriginally posted 2026.09.23

Open original on X

Where does Jev end and a fine-tuned small model begin? We built an invoice pipeline with both; sorting the inbox: Jev 200/200, nothing to train. Deciding whether to pay: Jev lands at 0.79 but a 4B fine-tuned to reason first gets 0.98. Details from @distil_labs below.