Cloudflare Clef benchmarked against Jev
The eval finds Clef wins on coding and safety/security but is too expensive to count as a Jev-class model, while clef-flash ranks #12 overall.
Does the @Cloudflare Jev win? Due to public interest, results of my clef and clef-flash eval. Short answer: No. Longer answer: - Both are strong models, in model routing use case they even beat original Jev. - clef-flash is generally weaker than clef or Jev. - clef winning vs Jev in coding and safety/security but pretty much same or weaker than Jev on everything else. - Biggest issue: clef is too pricy (!) In Capability Score clef-flash scores #12 and clef is disqualified because so expensive that my benchmark does't even regard it as a Jev-class model. In Composite Score they score #25 and #62 each (mostly because of the cost dimension) You can experiment with the leaderboard and adjust the parameters here: https://benchmarkheaven.com/jev-models?compare=jev-1.13.0%2Cclef#compare