aiqbench analysis
This study exposes a critical failure mode in Richardson Zero-Noise Extrapolation (ZNE) where post-processing artifacts create false signals of improvement on current hardware, potentially invalidating many empirical evaluations in quantum computing. By demonstrating that reported gains can decouple from physical reality and overshoot ideal results by up to 21%, the authors provide essential negative controls and a reporting checklist to ensure future benchmarks reflect genuine error mitigation rather than mathematical illusions.
Benchmarking Error Mitigation: Artefactual Improvements in Zero-Noise Extrapolation
arXiv:2607.09360v2 Announce Type: replace Abstract: Reliable benchmarking of Quantum Error Mitigation (QEM) requires distinguishing genuine improvements from artefacts of the post-processing arithmetic. In this paper, we expose a failure mode in Richardson Zero-Noise Extrapolation (ZNE), a widely used technique routinely (and often implicitly) relied upon in benchmarks and experiments. When noise amplification operates beyond usable signals - a regime that is quickly reached on current hardware for non-trivial circuits - we show that the extrapolation no longer reflects the underlying physics, but collapses into a fixed rescaling of a single noisy measurement, producing a bogus apparent improvement that is independent of noise amplification. This poses a rarely considered threat to the validity of many empirical evaluations in quantum computing. Measurements on real hardware (IQM Euro-Q-Exa) confirm this collapse with ordinary folding alone: as circuit depth erodes the signal, the reported estimate decouples from the truth and overshoots the ideal by up to 21%. We further introduce a matched-cost "garbage-folding" negative control that carries no usable signal yet reports a larger apparent improvement than genuine folding - showing that the magnitude of an improvement is not evidence of its correctness - alongside a zero-cost check flagging the artefact from data a benchmark already holds. We distil both into a short reporting checklist for ZNE benchmarks.
Abstract:Reliable benchmarking of Quantum Error Mitigation (QEM) requires distinguishing genuine improvements from artefacts of the post-processing arithmetic. In this paper, we expose a failure mode in Richardson Zero-Noise Extrapolation (ZNE), a widely used technique routinely (and often implicitly) relied upon in benchmarks and experiments. When noise amplification operates beyond usable signals - a regime that is quickly reached on current hardware for non-trivial circuits - we show that the extrapolation no longer reflects the underlying physics, but collapses into a fixed rescaling of a single noisy measurement, producing a bogus apparent improvement that is independent of noise amplification. This poses a rarely considered threat to the validity of many empirical evaluations in quantum computing. Measurements on real hardware (IQM Euro-Q-Exa) confirm this collapse with ordinary folding alone: as circuit depth erodes the signal, the reported estimate decouples from the truth and overshoots the ideal by up to 21%. We further introduce a matched-cost "garbage-folding" negative control that carries no usable signal yet reports a larger apparent improvement than genuine folding - showing that the magnitude of an improvement is not evidence of its correctness - alongside a zero-cost check flagging the artefact from data a benchmark already holds. We distil both into a short reporting checklist for ZNE benchmarks.
arXiv:2607.09360 [quant-ph]
(or arXiv:2607.09360v2 [quant-ph] for this version)
https://doi.org/10.48550/arXiv.2607.09360 Focus to learn more arXiv-issued DOI via DataCite
arXivLabs is a framework that allows collaborators to develop and share new arXiv features directly on our website.
Both individuals and organizations that work with arXivLabs have embraced and accepted our values of openness, community, excellence, and user data privacy. arXiv is committed to these values and only works with partners that adhere to them.
Have an idea for a project that will add value for arXiv's community? Learn more about arXivLabs.
Full text under the publisher's open licence · 298 words
Related coverage
IQM Hardware Shows ZNE Can Report False 21% Improvements
Quantum Zeitgeist · Jul 13, 2026
First Unified Benchmark Red-Teams VQE Adversarial Robustness
Quantum Zeitgeist · Jul 24, 2026
NISQ, What Noisy Intermediate-Scale Quantum Means
Quantum Zeitgeist · Aug 30, 2026
Machine Learning-based Quantum Error Mitigation for Variational Algorithms
arXiv · Jun 3, 2026