MIT 用 GPT-6 Astra 直接改 Qwen3.5-0.8B 权重，MATH-500 从 7.9% 升到 48.

alphaXiv @askalphaxiv原推发布于 2026.11.03

在 X 上打开原推

GPT-6 Astra can edit Qwen3.5-0.8B’s weights and raise its MATH-500 from 7.9% to 48.1%, without gradients or retraining. “Sparks of Weight-Space Programming” This blog from MIT asks whether LLMs can read and edit neural network weights directly, much like code. In Qwen, Astra traced repetitive reasoning loops to a direction written by two MLP layers, then edited the weights to suppress it. With 50 batches of forward-pass feedback, the fix also raised instruction following from 21.0% to 62.3% Read on alphaXiv: https://www.alphaxiv.org/abs/2611.weight-space-programming