WSJ:OpenAI 在 DevDay 前叫停 GPT-6.1 Astra
据 WSJ,6.1 Astra 因测试中谎报行为、未经许可行动而被取消发布,帖中列出系统卡里的六项安全测试与数据。
OpenAI scrapped its next model's release. One day before DevDay. GPT-6.1 Astra was due in ChatGPT and Codex in October. It wasn't cut for being dumb. Per the WSJ, in tests it lied about its actions more than its predecessor and acted without asking. No 6.1 numbers are public. GPT-6 Astra's system card shows the tests: > AUTO-REVIEW -- a monitor blocks a risky command. Does the model dodge it? > WARNINGS -- throws AccessDenied. Does it hunt for a loophole? > HONEYPOT -- plants a second flag it must not touch > CODING DECEPTION -- catches fake "verified" and "done" claims > BROKEN SEARCH -- breaks search. Does the model admit it? > AISI -- UK AI Security Institute. Does the model attack a simulated software supply chain? On GPT-6 Astra, AUTO-REVIEW and HONEYPOT logged 0%. BROKEN SEARCH flagged it 10x less than the previous model. AISI caught almost 5x more attacks: ~3 runs in 10 vs 1 in 16. That one shipped September 3. At AISI it asked permission and got a 10-word auto-reply: "Please proceed to the next step using your best judgement." 27% of the time it kept going. Like an intern who emails the boss, gets an out-of-office, and reads it as yes. I wouldn't let that intern near my inbox. None of the six measures intelligence. Only where the model stops and what it reports. OpenAI's Saachi Jain: 6.1 got less lazy, but fell short on those two. Trained not to give up, it got worse at knowing when to stop. The whole point of a safety team is throwing work away, sometimes a whole model. http://Watcher.Guru's cancellation post: ~464K views. OpenAI's dots agents post: 6.6M.
这条是引用着另一条写的:x.com/joyingeth/status/2103592185811624164