Jev 与 Gemini 3.8 Flash 标注 1000 条应用评论实测

Vaishnavi @_vmlops原推发布于 2026.09.19

在 X 上打开原推

Someone raced Jev against Gemini 3.8 Flash, labelling 1,000 real app reviews. Same data, same batches, same concurrency Jev: 4.6s, $0.023 Gemini 3.8 Flash: 18.8s, $0.158 4.1× faster. 7× cheaper. Quality gap? Basically none 84% topic agreement, 93% bug-call agreement, sentiment correlation 0.80 vs 0.82 Jev used 8× more input tokens (every question repeats its rubric) but still crushed on cost, because output tokens are free Fully open, zero dependencies, recorded runs you can replay for free no API key needed