开放权重编程基准:V4.1 1017 最强但不稳定,价格更低
四个开放权重模型跑同一编程基准,V4.1 1017 是这批最强,但表现不稳定,平均未明显超过上一版 4.1,部分环境更差,胜在价格便宜很多。


We ran a batch of 4 recent open weights releases through our open-ended coding benchmark over the weekend: - Muse Spark Open: currently the strongest US open weights model. Roughly equivalent to GLM 5.3 Flash. - Beam 1.0 501B: Solid release for a new entrant, roughly competitive with DeepSeek v4 Flash (07/31). - Nemotron 3.5 Super VL: A significant leap for NVIDIA (their strongest model to date), but still not a contender. - DeepSeek v4.1 10/17: strongest of the batch, but inconsistent in our testing. On average, it is not significantly better the previous 4.1 checkpoint. It performed worse than its predecessor in some of the same environments, but its current pricing made it much cheaper to run the same benchmark. The US models are all solid releases in their respective size classes, but none are Pareto optimal, with GLM 5.3 Flash performing the same or better at lower effective price.