aiqbench analysis
This paper argues for establishing new publishing norms in LLM-assisted mathematical research, specifically mandating the disclosure of prompts and software setups alongside machine-verifiable formalizations. The author further emphasizes the necessity for human researchers to provide intuitive explanations for results generated by models that may otherwise be opaque. These proposals address critical gaps in current community guidelines regarding transparency, reproducibility, and interpretability in AI-driven discovery.
Explanations, Prompts, and Formalizations: Arguments for New Norms in LLM-Enabled Mathematical Research
arXiv:2608.29401v1 Announce Type: cross Abstract: As several mathematical conjectures have recently been settled using large language models (LLMs), the mathematical community has formulated norms and recommendations regarding the publishing of such results. These norms do not cover the disclosure of the prompts and precise software setup used to obtain those results, nor do they require that results be formalized in a manner that allows for machine verification. I argue that both of these are essential. In addition, since LLM-obtained results may be hard to understand, human authors have the responsibility to invent intuitive explanations.
Abstract:As several mathematical conjectures have recently been settled using large language models (LLMs), the mathematical community has formulated norms and recommendations regarding the publishing of such results. These norms do not cover the disclosure of the prompts and precise software setup used to obtain those results, nor do they require that results be formalized in a manner that allows for machine verification. I argue that both of these are essential. In addition, since LLM-obtained results may be hard to understand, human authors have the responsibility to invent intuitive explanations.
History and Overview (math.HO); Machine Learning (cs.LG)
arXiv:2608.29401 [math.HO]
(or arXiv:2608.29401v1 [math.HO] for this version)
https://doi.org/10.48550/arXiv.2608.29401 Focus to learn more arXiv-issued DOI via DataCite (pending registration)
arXivLabs is a framework that allows collaborators to develop and share new arXiv features directly on our website.
Both individuals and organizations that work with arXivLabs have embraced and accepted our values of openness, community, excellence, and user data privacy. arXiv is committed to these values and only works with partners that adhere to them.
Have an idea for a project that will add value for arXiv's community? Learn more about arXivLabs.
Full text under the publisher's open licence · 187 words
Related coverage

[AINews] Reality Checks on AI News (Yegge shuts down Gas Town, Databricks’ +60% Astra cost)
Latent Space · Sep 17, 2026

Hint-based CoT faithfulness evals still mostly work on Claude
LessWrong · Jul 30, 2026
The Continual Constitutional Convention: How language models revise the documents that govern them
AI Alignment Forum · Oct 13, 2026

Why don’t machine learning research agents overfit?
Amazon Science · Sep 10, 2026