Xerj launches Corpus Hub with 103 open-source knowledge corpora for agents
Agents search a corpus and pull only relevant passages instead of ingesting whole files; one test showed 57% lower cost and task completion rising from 7/16 to 16/16.
this is f*cking insane, that's what your agent looks like when it stops reading everything over and over Xerj launched Corpus Hub: 103 open-source knowledge corpora your agent can search instead of swallowing whole files the problem is simple, most agents dump entire documents into context just to find one paragraph you pay for every token, every single time with a corpus, the agent works differently: - it searches the corpus before opening anything - it pulls only the passages that answer the task - everything else stays out of the context window - it runs locally, so your files stay on your machine a bigger context window doesn't make an agent smarter, it just makes reading more expensive i gave my agent the same task with and without Xerj, here's the difference: > output tokens: 3× fewer > cost: $4.57 down to $1.98, 57% lower > tasks completed: 7/16 without Xerj, 16/16 with Xerj pick a corpus on http://hub.xerj.org, connect it to your agent, then ask: "Work on this task using the connected corpus 1. Search the corpus before opening any full document 2. Pull only the passages you need and note where each one came from 3. If the corpus doesn't cover something, say so instead of guessing 4. At the end, list the passages you used and the files you never had to open" start with one corpus that matches your stack and one real task, then compare the token count before and after
This post quotes another post: “XERJ Corpus Hub launches as reference memory for agents”