WildAWM 开源环境任务合成,GPT-6 Astra 仅 72.7 pass@8
全开源合成 341 个环境–任务对,GPT-6 Astra 在难度筛选下 pass@8 仅约 72.7,Qwen3.6-35B-A3B 纯合成世界 RL 训练后 8 项 OOD 基准平均涨 10.58 分。
🔥 Excited to share Agent World Model in the Wild (WildAWM)! 🌍 Fully open-source synthesis 🔓: No proprietary models needed! We synthesized 341 high-quality environment–task pairs, addressing 3 challenges in task synthesis: ✅ Solvability: At least one agent can successfully complete each task. 🔥 Difficulty: Challenging even for frontier models, with GPT-6-Astra achieving only ~72.7 pass@8. 🎯 Verifier reliability: 95% agreement between task verifiers and agent-as-a-judge ensemble. 📈 Effective RL training: Trained exclusively in these synthetic worlds, Qwen3.6-35B-A3B achieves an average +10.58-point improvement across 8 OOD benchmarks!