Stanford and Together AI let agent teams learn their own collaboration strategy
Three models working as a self-organizing team averaged 66.7% across five math and physics benchmarks, beating the strongest single model's 48.8% and a perfect router's 59.0%, with strategies learned from just 15 problems.
Banger paper from Stanford and Together AI. They show why it might be a good idea to let your agent team learn its own way of working together. (bookmark it) Three models (o3-mini, Claude Sonnet 4 and DeepSeek-V3) averaged 66.7% across five math and physics benchmarks as a self-organizing team. Their strongest member alone scored 48.8%, and a perfect router choosing among the members' independent answers scored 59.0%. On AIME 2026 the team reached 71.2%, 13.4 points above that router. One member reviews the team's earlier exchanges and rewrites the teamwork strategy, covering roles, the order of discussion phases, who participates and how partial answers are combined. The strategies were learned from only 15 AIME 2024 problems and then applied unchanged to held-out AIME 2024 problems and four new benchmarks. Paper: https://t.co/TKy1Js5krQ