aiqbench analysis
This paper introduces a standardized benchmarking protocol using Peaked Random Circuits to holistically evaluate the performance of commercial quantum hardware against noise and connectivity constraints. By validating the method on both superconducting and trapped-ion architectures, it provides a scalable framework for objectively comparing whole-system fidelity rather than relying on isolated vendor metrics. This work is critical for establishing consistent evaluation standards as the industry transitions from experimental prototypes to deployed turnkey systems.
Evaluating System-Level Fidelity with Peaked Random Circuits
arXiv:2605.25983v2 Announce Type: replace Abstract: Quantum computing is progressing beyond experimental prototypes toward cloud-based services and commercially deployed turnkey systems. Evaluating and comparing platform performance requires robust, standardized measures, yet vendors frequently report heterogeneous metrics that are not directly comparable or may not capture whole-system performance. Peaked Random Circuits (PRCs) have recently been proposed as a viable path to demonstrate quantum advantage: a quantum processor can reliably identify a single known high-probability outcome while the circuits' inherent complexity may render classical simulation infeasible. To support robust, system-level evaluation and comparison, we propose a novel benchmarking protocol based on PRCs. By successively running a set of PRCs with varying qubit counts and circuit depths, we quantify a system's ability to identify the deterministic peak despite cumulative noise, gate errors, and connectivity constraints. We demonstrate the benchmark experimentally on IQM's superconducting and AQT's trapped-ion architectures. Our results show that the PRC benchmark provides a holistic yet high-precision view of hardware performance and offers researchers and industry stakeholders a practical and scalable framework for the continuous comparison and evaluation of current and future quantum systems.
Abstract:Quantum computing is progressing beyond experimental prototypes toward cloud-based services and commercially deployed turnkey systems. Evaluating and comparing platform performance requires robust, standardized measures, yet vendors frequently report heterogeneous metrics that are not directly comparable or may not capture whole-system performance. Peaked Random Circuits (PRCs) have recently been proposed as a viable path to demonstrate quantum advantage: a quantum processor can reliably identify a single known high-probability outcome while the circuits' inherent complexity may render classical simulation infeasible. To support robust, system-level evaluation and comparison, we propose a novel benchmarking protocol based on PRCs. By successively running a set of PRCs with varying qubit counts and circuit depths, we quantify a system's ability to identify the deterministic peak despite cumulative noise, gate errors, and connectivity constraints. We demonstrate the benchmark experimentally on IQM's superconducting and AQT's trapped-ion architectures. Our results show that the PRC benchmark provides a holistic yet high-precision view of hardware performance and offers researchers and industry stakeholders a practical and scalable framework for the continuous comparison and evaluation of current and future quantum systems.
V2: Updated and expanded. Added details on the sampling strategy in Section 3, restructured Sections 5 and 6, and illustrated the benchmarking protocol in Section 5
Quantum Physics (quant-ph); Emerging Technologies (cs.ET)
arXiv:2605.25983 [quant-ph]
(or arXiv:2605.25983v2 [quant-ph] for this version)
Full text under the publisher's open licence · 217 words
