Towards a Science of Scaling Agent Systems
research blog · source date 2026-04-01 · added 2026-08-07 15:52:43 · updated 2026-08-07 15:52:43 · Open original blog
1
Problems / challenges / motivations
- Multi-agent systems are adopted on the assumption that more agents means better results, with little controlled evidence.
- Comparisons across papers confound topology, model, and token budget.
- Errors propagate differently depending on how agents are wired together, and that effect is rarely measured.
2
Key ideas
- A large controlled sweep: 180 configurations, 5 canonical architectures, fixed token budgets.
- Centralized coordination improved the parallelizable Finance-Agent task by about 80.9%.
- Every multi-agent variant degraded sequential planning by 39–70% — the same architectures that help on decomposable work actively hurt on dependent chains.
- Topology strongly affects error amplification.
3
Why it matters for AI engineering
- This is the canonical top-lab reference for matching topology to task shape, and it anchors the shift from "more agents" to disciplined orchestration.
- The practical rule: parallelizable work rewards fan-out, sequential planning punishes it. Decide by task structure, not by architecture fashion.
- It complements the peer-reviewed Nature MI collaboration-threshold result, which reaches a compatible conclusion from the capability side.
- Caveat: the blog is treated as in-window while the companion arXiv preprint (2512.08296) predates it. Results are specific to the tested architectures, benchmarks, and token budgets.
Comments
No comments yet.