Inference-Time Amplification of Weak Reasoning Models

arXiv:2605.14163v2 Announce Type: replace Abstract: How much of the capability of a reasoning model exposed by repeated sampling can an imperfect selector recover? We study this problem as {\em inference-time amplification}, separating {\em coverage}---whether a useful candidate is generated---from {\em identifiability}---whether it can be recognized among the alternatives. We show that better coverage alone does not guarantee better selection, while even imperfect local selection signals can be amplified through repetition. We also characterize proposal-side blind spots that additional sampling cannot overcome. On SWE-bench Verified, a single GPT-5.4 nano trajectory solves 67.0\% of tasks, while eight proposals contain a correct patch on 79.0\%; critic--comparator selection reaches 76.4\%, recovering 78.3\% of the oracle-exposed gain. The same pattern appears across proposer families and in mathematical reasoning, competitive programming, and formal proof. On MATH L4--5 and GSM-Plus, our selector recovers 85\% and 77\% of the oracle gap and substantially outperforms majority vote. Holding proposal coverage fixed, providing the selector with additional repository information also improves recovery. Conversely, when the available selection signal is weak, redundant, or misaligned, amplification can diminish or fail. These results identify selection quality as the key factor governing how much capability exposed by repeated sampling can actually be recovered.

Abstract:How much of the capability of a reasoning model exposed by repeated sampling can an imperfect selector recover? We study this problem as {\em inference-time amplification}, separating {\em coverage}---whether a useful candidate is generated---from {\em identifiability}---whether it can be recognized among the alternatives. We show that better coverage alone does not guarantee better selection, while even imperfect local selection signals can be amplified through repetition. We also characterize proposal-side blind spots that additional sampling cannot overcome. On SWE-bench Verified, a single GPT-5.4 nano trajectory solves 67.0\% of tasks, while eight proposals contain a correct patch on 79.0\%; critic--comparator selection reaches 76.4\%, recovering 78.3\% of the oracle-exposed gain. The same pattern appears across proposer families and in mathematical reasoning, competitive programming, and formal proof. On MATH L4--5 and GSM-Plus, our selector recovers 85\% and 77\% of the oracle gap and substantially outperforms majority vote. Holding proposal coverage fixed, providing the selector with additional repository information also improves recovery. Conversely, when the available selection signal is weak, redundant, or misaligned, amplification can diminish or fail. These results identify selection quality as the key factor governing how much capability exposed by repeated sampling can actually be recovered.

Artificial Intelligence (cs.AI)

arXiv:2605.14163 [cs.AI]

(or arXiv:2605.14163v2 [cs.AI] for this version)

https://doi.org/10.48550/arXiv.2605.14163 Focus to learn more arXiv-issued DOI via DataCite

arXivLabs is a framework that allows collaborators to develop and share new arXiv features directly on our website.

Both individuals and organizations that work with arXivLabs have embraced and accepted our values of openness, community, excellence, and user data privacy. arXiv is committed to these values and only works with partners that adhere to them.

Have an idea for a project that will add value for arXiv's community? Learn more about arXivLabs.

analiza aiqbench

Inference-Time Amplification of Weak Reasoning Models

Subiecte conexe