Fine-tuning Qwen3.5-4B into a Jev-style decision model with Unsloth

Alok @analogalokOriginally posted 2026.10.10

Open original on X

Finetuned Qwen3.5-4B into a decision model like Jev using @UnslothAI. - 4-bit QLoRA, bf16, single A100, 15 min. - Train/val loss flatten after 2 epochs so most of the learning happens fast. - Trained just 64.5M params (2.1%) - accuracy jumps 30% -> 80% after 4 epochs on LocalLLaMA/typed-decisions eval dataset What should i try next?

This post quotes another post: “Unsloth releases open-source guide to training a Jev-style decision model locally”