腾讯混元发布 WebCraftBench 基准
基于 369 条真实用户请求构建,测试 AI 生成应用在非规范需求下的表现,17 个模型排名与 Code Arena 相关性达 0.89。
Real-world app requests don’t come as perfect specs. Congrats to the @TencentHunyuan team on WebCraftBench! Built from 369 requests collected from their internal replica of Code Arena, it embraces the messy details of real human usage: informal language, incomplete instructions, different project scopes, and diverse preferences. Their benchmark tests how AI-built apps look, work, and deliver on those requests. Across 17 models, its rankings strongly correlate with our Code Arena leaderboard (0.89). What could you uncover from real human-AI conversations and Arena’s leaderboard history? Explore our open datasets at https://t.co/UZLJX2b8UA!
这条是引用着另一条写的:x.com/i/web/status/2102320407860977861