Kaggle 与 IBM 发布 ScarfBench:Gemini 4 Argon 得分 75.2%
新基准 ScarfBench 用 204 个 Java 框架迁移任务测编码 agent,Gemini 4 Argon 配 Antigravity 得 75.2%,领先 Claude Opus 5.5 配 Claude Code 的 70.5%。

Today, in collaboration with @IBMResearch, we are launching ScarfBench (Self-Contained Application Refactoring Benchmark), an open benchmark designed to test whether coding agents can successfully migrate enterprise Java apps across frameworks like Jakarta EE, Quarkus, and Spring while maintaining the app’s expected behavior. Moving between frameworks takes coordinated changes across dependency injection, persistence, build systems, and deployment infrastructure. An agent can easily generate a migration that looks fine or compiles, only for the app to fail when deployed. ScarfBench puts that to the test. ScarfBench evaluates each model with its harness over 204 migration tasks. Gemini 4 Argon with Antigravity scores 75.2%, followed by Claude Opus 5.5 with Claude Code at 70.5%, and Claude Opus 5 with Claude Code at 69.8%.