Mirendil Fern: first model with up to 10M token context
Mirendil released Fern, its first from-scratch pretrained model with up to 10M tokens of context, aimed at agentic AI R&D work; larger models are in training.
Introducing Fern, Mirendil’s first model: pretrained from scratch, with up to 10 million tokens of context. That’s ~0.5M lines of code or days of an agent’s work - all in context at once. Built for high-volume agentic work in AI R&D: auditing training data, debugging training runs from logs, and reading agent traces end to end. Fern’s next-token prediction keeps improving as context grows to 10M tokens. Fern 0.1 is Mirendil-Base after a short round of post-training. It’s the first and smallest of three models, with two larger ones now being pretrained. We’ll ship frequent updates and make the model available soon.