WHAT NEW IN X10.30 FRI

X 上的 AI 合集档案 · 22 个合集 · 61,986 条

deepseek-v4.1POST

内部安全基准:DeepSeek V4.1 Flash 原版拒答 100%,去审查版 2%

作者对比 Morph 去审查版与原版 V4.1 Flash:拒答率 2% vs 100%,IFEval、MMLU-Pro、GSM8K 差异不显著;全仓库漏洞挖掘召回原版 8%、去审查版 0%。

@aaronjmars
@aaronjmars4 天前收录原推发布于 2026.10.26
@aaronjmars @aaronjmars原推发布于 2026.10.26
在 X 上打开原推

from my internal cyber meta bench: refusals on defensive audit + fix tasks (@ArtificialAnlys Cyber Index): Qwen3.8 61-63%, Fable 5.1 16%, GPT-6 Astra 13%, Opus 5.5 9% Morph abliterated vs stock DeepSeek V4.1 Flash: refusals 2% vs 100%, IFEval 87.6 vs 88.7, MMLU-Pro 84.0 vs 83.1, GSM8K 95.1 vs 95.4. none significant, no security tasks our whole-repo vuln hunt: stock V4.1 Flash 8% recall, an uncensored build of it 0% reward hacking: no paired data. DreadIndex caught 21 of 22 stock models cheating

x.com/aaronjmars/status/2114400635592347749采集于 2026.10.26 12:04