aiqbench analysis
The Endless Exam establishes a rigorous benchmark for measuring mathematical reasoning capabilities as AI models approach superintelligence, utilizing parameterized construction families to track progress beyond current human frontiers. By automating validity checks and assigning continuous quality scores against established baselines, this framework offers a scalable method for evaluating model performance on increasingly complex open problems without arbitrary caps. This work provides critical infrastructure for assessing the trajectory of mathematical AI research and its potential to solve long-standing theoretical challenges.
The Endless Exam: Mathematical Constructions from Today's Models toward Superintelligence
arXiv:2609.24555v1 Announce Type: new Abstract: We introduce the Endless Exam, a benchmark for measuring mathematical progress from today's models toward artificial superintelligence through fourteen parameterised construction families. Each submitted object is checked automatically for validity and assigned a relative quality score against a published frontier or construction baseline, without capping improvements at $1$. The families draw on open mathematical problems for long-term targets and generate new instances at larger parameters, where compact certificates keep large constructions verifiable. Across eight models evaluated on 69 distinct instances, continuous quality scores distinguish performance even though no evaluated system surpasses a published frontier. Size-quality curves show how construction quality changes as problem size increases. We release the generators, verifiers, references, model responses and analysis to support continued measurement before and beyond human frontiers.
Abstract:We introduce the Endless Exam, a benchmark for measuring mathematical progress from today's models toward artificial superintelligence through fourteen parameterised construction families. Each submitted object is checked automatically for validity and assigned a relative quality score against a published frontier or construction baseline, without capping improvements at $1$. The families draw on open mathematical problems for long-term targets and generate new instances at larger parameters, where compact certificates keep large constructions verifiable. Across eight models evaluated on 69 distinct instances, continuous quality scores distinguish performance even though no evaluated system surpasses a published frontier. Size-quality curves show how construction quality changes as problem size increases. We release the generators, verifiers, references, model responses and analysis to support continued measurement before and beyond human frontiers.
Artificial Intelligence (cs.AI); History and Overview (math.HO)
arXiv:2609.24555 [cs.AI]
(or arXiv:2609.24555v1 [cs.AI] for this version)
https://doi.org/10.48550/arXiv.2609.24555 Focus to learn more arXiv-issued DOI via DataCite (pending registration)
arXivLabs is a framework that allows collaborators to develop and share new arXiv features directly on our website.
Both individuals and organizations that work with arXivLabs have embraced and accepted our values of openness, community, excellence, and user data privacy. arXiv is committed to these values and only works with partners that adhere to them.
Have an idea for a project that will add value for arXiv's community? Learn more about arXivLabs.
Full text under the publisher's open licence · 222 words
Related coverage

[AINews] Reality Checks on AI News (Yegge shuts down Gas Town, Databricks’ +60% Astra cost)
Latent Space · Sep 17, 2026

The Entangled Dimensions of Decision Theory
LessWrong · Jul 30, 2026

Presentation: Beyond Prompting: Context Engineering and Memory Management for AI Systems at Scale
InfoQ · Jun 10, 2026
Predictor and picker – convergent architectural features of intelligent agents
LessWrong · Oct 15, 2026