思想实验:人类能不能就停在 Astra 这一代
作者设想把 AI 发展冻结在 GPT-6 Astra 水平、禁止再往深训练,讨论这是否可行、代价是否真那么大。
Could humanity theoretically decide to pause AI development at GPT 6 Astra capability level - with companies not allowed to train past this point - and would this really be so bad? Astra looks pretty good, it apparently appears to be almost at the level of AGI in the sense that it performs at human expert level across nearly all domains. It will apparently enable major new scientific advances. Could we theoretically pause humanity at this level of AI development in order to head off existential risks? Because we are starting to get to the point that rogue agent swarms threaten us. I am just asking this as thought experiment, I am generally very techno-optimist and pro-AI. Human adoption is still at such low rates that the vast majority of educated professionals are still just using AI as a chatbot and many of them are still using older models several generations behind the frontier because they don’t even realise there’s a difference. So even if we paused at Astra level you could still unlock massive economic productivity gains just by getting Boomers to use it correctly etc.