SAM as the Jev of segmentation, and a vision for local specialist models
The author compares SAM to Jev for segmentation and imagines locally runnable open-weight specialists for web navigation, data viz and video editing, orchestrated by a generalist agent.
SAM (Segment Anything Model) is my favorite AI model. I love what SAM represents! SAM came into the world, and from its first day, it was: * LocalAI * Open Weight SAM is small enough to have a useful version that runs on mobile and in the browser, yet! SAM is capable enough at segmentation to still beat ALL frontier models! SAM is Jev for segmentation, or rather, Jev is SAM for classification. All in all, SAM is very “unthreatening” AI. I believe SAM is a wonderful form factor for AI. I can't wait to have more models like that. Could we have a frontier-beating, locally runnable, open-weight model for navigating a website, creating data visualizations, analyzing data, and editing a video? Then have a big generalist agent call them one after another?