aiqbench analysis
This study investigates how communication topologies among Large Language Model teams affect their ability to discover scientific laws via symbolic regression. The findings indicate that distributing computational budgets across independent trajectories yields the best performance, while specific interaction structures like Ring or Star do not universally outperform others when selection rules are unspecified. Consequently, researchers should treat candidate generation and final answer selection as distinct metrics rather than relying solely on aggregate scores to evaluate team architecture.
The Weight of Teamwork: Does Communication Structure Help LLM Scientists Search for Scientific Laws?
arXiv:2610.24131v1 Announce Type: cross Abstract: Team performance is often reported as one delivered score, even though that score is produced in two stages: a system generates candidate answers and a selection rule returns one of them. We use symbolic regression as an observable scientific-search setting and compare fixed-budget LLM teams that differ in peer visibility and update timing, evaluating both their frozen candidate archives and the expressions selected from those archives. Distributing the call budget across more independent trajectories produced the largest measured gain, improving mean held-out fitting score Q by 0.70 at the widest tested allocation. Under a common archive-wide selector, the implemented Ring policy reduced mean Q by 0.33 relative to Independent, while Star and Complete remained unresolved. Holding the generated archives fixed, changing the delivery rule changed the measured architecture gaps, including the sign of the Complete point estimate. These results support reporting candidate generation and final selection as separate endpoints. They do not identify a communication mechanism or a universally preferred topology; rather, they show that an architecture ranking is not identified by communication structure alone when the rule that returns the final answer is left unspecified.
Abstract:Team performance is often reported as one delivered score, even though that score is produced in two stages: a system generates candidate answers and a selection rule returns one of them. We use symbolic regression as an observable scientific-search setting and compare fixed-budget LLM teams that differ in peer visibility and update timing, evaluating both their frozen candidate archives and the expressions selected from those archives. Distributing the call budget across more independent trajectories produced the largest measured gain, improving mean held-out fitting score Q by 0.70 at the widest tested allocation. Under a common archive-wide selector, the implemented Ring policy reduced mean Q by 0.33 relative to Independent, while Star and Complete remained unresolved. Holding the generated archives fixed, changing the delivery rule changed the measured architecture gaps, including the sign of the Complete point estimate. These results support reporting candidate generation and final selection as separate endpoints. They do not identify a communication mechanism or a universally preferred topology; rather, they show that an architecture ranking is not identified by communication structure alone when the rule that returns the final answer is left unspecified.
Accepted at the NeurIPS 2026 Workshop on Foundations of Agentic Systems Theory (FAST), non-archival. 7 pages main text, 33 pages total with appendices
Multiagent Systems (cs.MA); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)
arXiv:2610.24131 [cs.MA]
(or arXiv:2610.24131v1 [cs.MA] for this version)
https://doi.org/10.48550/arXiv.2610.24131 arXiv-issued DOI via DataCite (pending registration)
Full text under the publisher's open licence · 233 words
Related coverage

Why I Left Google DeepMind
LessWrong · Jul 15, 2026
The J-Space Debate, Agent Swarms, and Pacing Frontier AI - Digital Minds Newsletter #4
LessWrong · Sep 18, 2026

34 Amazon Research Awards Build on Trainium recipients announced
Amazon Science · Aug 5, 2026

Forbes Asia 100 To Watch 2026
forbes.com · Aug 24, 2026