WHAT NEW IN X11.04 WED

X 上的 AI 合集档案 · 22 个合集 · 66,612 条

gpt-6IMAGE

前沿模型简单乘法盲区:Fable 5.1 对比 Astra

低推理档的 Fable 5.1 在 5x6 这类乘法上准确率跌到约 0%,而 GPT-6 Astra 没这个盲区,作者借此谈泛化与安全研究。

Maksym Andriushchenko
@maksym_andr2026.09.17收录原推发布于 2026.09.17
前沿模型简单乘法盲区:Fable 5.1 对比 Astra
Maksym Andriushchenko @maksym_andr原推发布于 2026.09.17
在 X 上打开原推

💥 The multiplication saga continues! It turns out, some frontier LLMs do struggle with simple multiplications. Unlike GPT-6-Astra, Fable 5.1 with low reasoning has a blind spot where the accuracy of, say, 5x6 multiplications drops to ~0%! The failure mode is very interesting: the 0% zone corresponds to a failure of adaptive thinking. The model decides that it shouldn't produce any reasoning and outputs the (wrong) answer directly. For larger multiplications, however, the model realizes it should produce a CoT first and then it gets the answer correctly. For very large multiplications (close to 20x20), the accuracy degrades again. How many such simple blind spots do frontier LLMs still have? This is why slowing down and carefully studying generalization and safety is the top priority... 1/2

x.com/maksym_andr/status/2100364212207837560采集于 2026.09.17 10:16