Surge 发布 sudo L7 编程 agent 基准测试
60 道专家任务取材真实私有生产代码库，从八个维度考察 agent 是否具备资深工程师判断力，最高分不到 45%。
Introducing sudo L7: Can Coding Agents Act Like Staff Engineers? Coding agents are getting very good at solving well-defined problems. But staff engineers do much more than write correct code. They understand unfamiliar systems, make architectural decisions, spot risks the ticket never mentioned, and know when passing the tests isn't enough. sudo L7 measures that judgment. Our new software engineering benchmark contains 60 expert-authored tasks, primarily in private production codebases from real companies, complete with legacy code, technical debt, and messy dependencies. We evaluate eight dimensions of engineering behavior, from functional correctness and engineering craft to practical judgment, thought partnership, and knowing when to push back. The best-performing agents score under ~45%. Coding is only part of the job. See you next cycle. Explore sudo L7: https://surgehq.ai/blog/sudo-l7