前神经科学家用双系统解释 Astra 为何要配小模型
作者类比人脑快慢双系统，认为 Astra 若被机械手视觉 token 占满上下文就做不了前沿数学，需搭配更快更笨的模型。
as a former neuroscientist, can't emphasize how much system one is important to real intelligence why do we need a dumber but fast model (system one, unconscious) in our brain? it frees the slower but smarter model (system two, conscious) to focus on what really matters, making it a lot better as a human, i can consciously control my body/hand, etc, but if i do that, i can't really be doing other tasks that require intelligence. similarly, gpt 6 astra is extremely intelligent, & you can control a robotic hand with it, but if won't be able to do frontier math if it's context window is polluted with robot hand vision/control tokens combining a powerful smart model with a faster, dumber, but still very intelligent model is the way to go very excited about this line of research
这条是引用着另一条写的：「ChatGPT 联合发明人发布新模型 Jev」