jevVIDEO

Local metasearch engine re-ranks via a Jev-like API on vLLM

A developer replicated a Jev-style interface on vLLM with DiffusionGemma, using structured decisions for re-ranking and normal text generation with tool calling for summaries, all running locally.

Matt Mastracci

@mmastracArchived 2026.09.24Originally posted 2026.09.24

Matt Mastracci @mmastracOriginally posted 2026.09.24

Open original on X

Built a DiffusionGemma perf test: 100% local metasearch engine using the Jev-like API on top of vLLM. Fully implemented with DiffusionGemma and djev! The re-ranking is done via structured decisions and the summary is written using the normal text generation + tool-calling mode.

x.com/mmastrac/status/2102795054930964917Archived 2026.09.24 10:15