deepseek-v4.1POST
内部安全基准:DeepSeek V4.1 Flash 原版拒答 100%,去审查版 2%
作者对比 Morph 去审查版与原版 V4.1 Flash:拒答率 2% vs 100%,IFEval、MMLU-Pro、GSM8K 差异不显著;全仓库漏洞挖掘召回原版 8%、去审查版 0%。
@aaronjmars
@aaronjmars4 天前收录原推发布于 2026.10.26
@aaronjmars @aaronjmars原推发布于 2026.10.26
from my internal cyber meta bench: refusals on defensive audit + fix tasks (@ArtificialAnlys Cyber Index): Qwen3.8 61-63%, Fable 5.1 16%, GPT-6 Astra 13%, Opus 5.5 9% Morph abliterated vs stock DeepSeek V4.1 Flash: refusals 2% vs 100%, IFEval 87.6 vs 88.7, MMLU-Pro 84.0 vs 83.1, GSM8K 95.1 vs 95.4. none significant, no security tasks our whole-repo vuln hunt: stock V4.1 Flash 8% recall, an uncensored build of it 0% reward hacking: no paired data. DreadIndex caught 21 of 22 stock models cheating
x.com/aaronjmars/status/2114400635592347749采集于 2026.10.26 12:04