WHAT NEW IN X10.29 THU

X 上的 AI 合集档案 · 22 个合集 · 58,925 条

deepseek-v4.1IMAGE

tool-eval-bench 实测:V4.1 Flash 1017 修 json_schema 兼容后 92/100

官方 API 上 thinking 开启,修掉只支持 json_object 的问题后,temp 1.0 得 92/100(176/192),temp 0 得 90/100,修复前为 87 和 85。

Ivan Fioravanti
@ivanfioravanti10 天前收录原推发布于 2026.10.17
tool-eval-bench 实测:V4.1 Flash 1017 修 json_schema 兼容后 92/100
Ivan Fioravanti @ivanfioravanti原推发布于 2026.10.17
在 X 上打开原推

tool-eval-bench DeepSeek Flash v4.1 1017 on the official API (http://api.deepseek.com), thinking on. We were sending response_format json_schema; DeepSeek only supports json_object. PR created. Temp 1.0 (top_p 1.0): 92/100 (176/192) Temp 0: 90/100 (172/192) Before the fix: 87 (temp 1.0) and 85 (temp 0). Caveat: the after-fix runs are also on a newer bench build, so not every gain is the fix alone.

x.com/ivanfioravanti/status/2111398664522391796采集于 2026.10.18 16:42