WHAT NEW IN X11.03 TUE

X 上的 AI 合集档案 · 22 个合集 · 65,263 条

jevIMAGE

开发者指出 Jev 返回的 confidence 有误导性

批评 Jev API 的置信度复用网络输出概率,不构成贝叶斯意义上的数据不确定性,容易让开发者高估它。

AVB
@neural_avb29 天前收录原推发布于 2026.10.03
开发者指出 Jev 返回的 confidence 有误导性
AVB @neural_avb原推发布于 2026.10.03
在 X 上打开原推

Love Jev but what the API returns as confidence is extremely misleading - and I feel many devs are unknowingly overestimating what it actually is. They reuse the network's output probs to calculate these so-called "confidence scores". Meaning the same weights and compute graph generate both the probabilities and the confidence. Therefore, this confidence score does NOT measure data uncertainty in a bayesian sense. It carries no extra information. Network can be confidently wrong coz the same process produces both the result and the confidence. To their credit, typesafe ai docs do acknowledge this.

这条是引用着另一条写的:x.com/typesafeai/status/2106197282274324846

x.com/neural_avb/status/2106315968561729929采集于 2026.10.04 10:05