analiza aiqbench
This research demonstrates that multi-agent debate systems only outperform simple majority voting when they combine broad proposal coverage with truth-sensitive verification evidence. By formalizing these requirements through "recoverable headroom" and introducing Latent Verification Debate, the study provides a rigorous framework for improving reasoning accuracy in stochastic evaluations. These findings offer critical insights into optimizing agent societies to ensure correct answers are surfaced and selected even when initial voting mechanisms fail.
When Debate Helps: Proposal Supply and Verification-Aware Readout in Multi-Agent Reasoning
arXiv:2610.04686v1 Announce Type: new Abstract: Multi-agent debate can improve reasoning, yet often fails to beat simple majority voting. We argue that successful debate requires two distinct mechanisms: proposal supply must surface a correct answer, and readout must identify that answer when voting misses it. We formalize the first requirement through recoverable headroom, which measures cases where a correct proposal is available but the majority answer is wrong. For the second, we develop Latent Verification Debate (LVD), an accounting model in which candidate proposals receive answer-specific verification evidence before final generation. Controlled fixed-proposal interventions estimate this latent effect in equivalent peer-support units and show that correct evidence changes answer probabilities and generated decisions while proposal supply remains fixed. To improve proposal supply, we construct societies from neural-thicket agents using labeled and label-free coverage objectives. Across two backbones and matched-budget reasoning benchmarks, coverage-selected societies increase complementary proposal supply and improve aggregate accuracy in repeated stochastic evaluations. Round-level controls further show that interaction provides gains beyond applying the same finalizer directly to the initial proposals. These results identify proposal coverage and truth-sensitive evidence use as complementary conditions for debate to outperform voting. Code is available at https://github.com/Wang-ML-Lab/when-debate-helps.
Abstract:Multi-agent debate can improve reasoning, yet often fails to beat simple majority voting. We argue that successful debate requires two distinct mechanisms: proposal supply must surface a correct answer, and readout must identify that answer when voting misses it. We formalize the first requirement through recoverable headroom, which measures cases where a correct proposal is available but the majority answer is wrong. For the second, we develop Latent Verification Debate (LVD), an accounting model in which candidate proposals receive answer-specific verification evidence before final generation. Controlled fixed-proposal interventions estimate this latent effect in equivalent peer-support units and show that correct evidence changes answer probabilities and generated decisions while proposal supply remains fixed. To improve proposal supply, we construct societies from neural-thicket agents using labeled and label-free coverage objectives. Across two backbones and matched-budget reasoning benchmarks, coverage-selected societies increase complementary proposal supply and improve aggregate accuracy in repeated stochastic evaluations. Round-level controls further show that interaction provides gains beyond applying the same finalizer directly to the initial proposals. These results identify proposal coverage and truth-sensitive evidence use as complementary conditions for debate to outperform voting. Code is available at this https URL.
Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG); Multiagent Systems (cs.MA); Social and Information Networks (cs.SI)
arXiv:2610.04686 [cs.AI]
(or arXiv:2610.04686v1 [cs.AI] for this version)
https://doi.org/10.48550/arXiv.2610.04686 arXiv-issued DOI via DataCite (pending registration)
Text integral sub licența deschisă a publicației · 224 cuvinte
Subiecte conexe

News
Quantum Computing Report · 25 iul. 2026

[AINews] Reality Checks on AI News (Yegge shuts down Gas Town, Databricks’ +60% Astra cost)
Latent Space · 17 sept. 2026
State of the Field: AI for Epistemics and Coordination
LessWrong · 2 oct. 2026
Problems of Proliferation
LessWrong · 29 sept. 2026