deepseek-v4.1IMAGE
tool-eval-bench 实测:V4.1 Flash 1017 修 json_schema 兼容后 92/100
官方 API 上 thinking 开启,修掉只支持 json_object 的问题后,temp 1.0 得 92/100(176/192),temp 0 得 90/100,修复前为 87 和 85。
Ivan Fioravanti
@ivanfioravanti10 天前收录原推发布于 2026.10.17

Ivan Fioravanti @ivanfioravanti原推发布于 2026.10.17
tool-eval-bench DeepSeek Flash v4.1 1017 on the official API (http://api.deepseek.com), thinking on. We were sending response_format json_schema; DeepSeek only supports json_object. PR created. Temp 1.0 (top_p 1.0): 92/100 (176/192) Temp 0: 90/100 (172/192) Before the fix: 87 (temp 1.0) and 85 (temp 0). Caveat: the after-fix runs are also on a newer bench build, so not every gain is the fix alone.
x.com/ivanfioravanti/status/2111398664522391796采集于 2026.10.18 16:42