周末用 Jev 思路重造 Siri 式助手
作者用 1 万条意图样本微调开源替代 Laya，在设备端约 100ms 内决定该触发计时器、提醒还是音乐，瓶颈反而在苹果自家 API。
Apple pays Google $1 billion a year for Siri. I rebuilt it over the weekend with Jev. Meet Jav, an assistant that makes decisions faster thanks to Laya, the open-weight alternative to Jev, running entirely on-device with CoreAI. I fine-tuned it on 10,000 intent samples covering around 100 different actions an iPhone assistant might need to take. It takes a request and decides what should happen: timer, reminder, calendar event, music, weather... Laya makes the routing decision in around 100 ms. Surprisingly, the bottleneck comes from Apple's own Foundation Model and App Intents APIs. Decisions are solved, now let's make actions smarter and faster with another on device model.