Baseten Mammoth 对比 Jev：2891 条决策评测
作者为代码理解管线寻找廉价决策模型，在 2891 条共识字段上 Mammoth 比 Jev 高 15%，但担心 27B 模型吞吐撑不住。
Baseten cooked so hard with this Mammoth model its unreal. I have been trying to find very cheap and fast Jev alternatives for my code understanding pipelines to filter traces. Getting a cheap decision algorithm to work at a massive scale has been a challenge especially with jev's small context window. In my internal eval test set of 2891 consensus fields mammoth beat Jev by a lead of 15% and that's amazing for a fully free open weights model. The only deciding factor now would be if this model could also compete on pricing. If the hosted offering of this model turns out of be cheaper than Jev then I will fully switch to this. Right now, its free and open weights but I am not sure my sparks can handle 300 concurrent threads and high throughput for a 27 B model.
这条是引用着另一条写的：x.com/2079474328664719360/status/211295558705945…