Skip to content

Benchmarks · sources

Sources & attribution

aiqbench aggregates per-axis LLM leaderboards from public datasets. This page lists, for each source, the canonical link, the underlying dataset we ingest, its licence, and the exact attribution string — including the modifications we apply (subset selection, schema normalisation, rank recomputation).

Every board we aggregate, how fresh it is, and when it refreshes next. An empty board says why it is empty. The attribution each licence requires is folded under its row.

ARC-AGI-2

ARC Prize
Entries267Last sync55 seconds agoUpstream changed 60 seconds ago · checked 60 seconds agoNext syncin 12 hoursLicenceCC-BY-4.0HealthFresh
Attribution & dataset
epoch.ai/…/benchmark_data.zip

Source: Epoch AI, 'AI Benchmarking Hub'. Published online at epoch.ai. Retrieved from https://epoch.ai/benchmarks. Licensed under CC BY 4.0 (https://creativecommons.org/licenses/by/4.0/). Modified by aiqbench: normalised into aiqbench's common board format; we ingest the 'arc_agi_2_external.csv' table and rescale its 0-1 scores to percent. Underlying results published by ARC Prize — https://arcprize.org/leaderboard, transcribed by Epoch AI.

Arena · Agent

arena.ai (LMArena)
Entries80Last sync6 hours agoUpstream changed yesterday · checked 60 seconds agoNext syncin 6 hoursLicenceCC-BY-4.0HealthFresh
Attribution & dataset
huggingface.co/…/leaderboard-dataset

Source: LMArena / arena.ai Leaderboard Dataset (lmarena-ai/leaderboard-dataset) on Hugging Face — https://huggingface.co/datasets/lmarena-ai/leaderboard-dataset. Licensed under CC BY 4.0 (https://creativecommons.org/licenses/by/4.0/). Modified by aiqbench: normalised into aiqbench's common board format; we ingest the latest snapshot of the 'agent' config.

Arena · Document

arena.ai (LMArena)
Entries44Last sync6 hours agoUpstream changed yesterday · checked 60 seconds agoNext syncin 6 hoursLicenceCC-BY-4.0HealthFresh
Attribution & dataset
huggingface.co/…/leaderboard-dataset

Source: LMArena / arena.ai Leaderboard Dataset (lmarena-ai/leaderboard-dataset) on Hugging Face — https://huggingface.co/datasets/lmarena-ai/leaderboard-dataset. Licensed under CC BY 4.0 (https://creativecommons.org/licenses/by/4.0/). Modified by aiqbench: normalised into aiqbench's common board format; we ingest the latest snapshot of the 'document_style_control' config.

Arena · Factuality

arena.ai (LMArena)
Entries3,932Last sync6 hours agoUpstream changed yesterday · checked 60 seconds agoNext syncin 6 hoursLicenceCC-BY-4.0HealthFresh
Attribution & dataset
huggingface.co/…/leaderboard-dataset

Source: LMArena / arena.ai Leaderboard Dataset (lmarena-ai/leaderboard-dataset) on Hugging Face — https://huggingface.co/datasets/lmarena-ai/leaderboard-dataset. Licensed under CC BY 4.0 (https://creativecommons.org/licenses/by/4.0/). Modified by aiqbench: normalised into aiqbench's common board format; we ingest the latest snapshot of the 'text_factuality' config.

Arena · Image Edit

arena.ai (LMArena)
Entries103Last sync6 hours agoUpstream changed yesterday · checked 60 seconds agoNext syncin 6 hoursLicenceCC-BY-4.0HealthFresh
Attribution & dataset
huggingface.co/…/leaderboard-dataset

Source: LMArena / arena.ai Leaderboard Dataset (lmarena-ai/leaderboard-dataset) on Hugging Face — https://huggingface.co/datasets/lmarena-ai/leaderboard-dataset. Licensed under CC BY 4.0 (https://creativecommons.org/licenses/by/4.0/). Modified by aiqbench: normalised into aiqbench's common board format; we ingest the latest snapshot of the 'image_edit' config.

Arena · Search

arena.ai (LMArena)
Entries42Last sync6 hours agoUpstream changed yesterday · checked 60 seconds agoNext syncin 6 hoursLicenceCC-BY-4.0HealthFresh
Attribution & dataset
huggingface.co/…/leaderboard-dataset

Source: LMArena / arena.ai Leaderboard Dataset (lmarena-ai/leaderboard-dataset) on Hugging Face — https://huggingface.co/datasets/lmarena-ai/leaderboard-dataset. Licensed under CC BY 4.0 (https://creativecommons.org/licenses/by/4.0/). Modified by aiqbench: normalised into aiqbench's common board format; we ingest the latest snapshot of the 'search_style_control' config.

Arena · Text

arena.ai (LMArena)
Entries11,033Last sync6 hours agoUpstream changed yesterday · checked 60 seconds agoNext syncin 6 hoursLicenceCC-BY-4.0HealthFresh
Attribution & dataset
huggingface.co/…/leaderboard-dataset

Source: LMArena / arena.ai Leaderboard Dataset (lmarena-ai/leaderboard-dataset) on Hugging Face — https://huggingface.co/datasets/lmarena-ai/leaderboard-dataset. Licensed under CC BY 4.0 (https://creativecommons.org/licenses/by/4.0/). Modified by aiqbench: normalised into aiqbench's common board format; we ingest the latest snapshot of the 'text_style_control' config.

Arena · Text-to-Image

arena.ai (LMArena)
Entries680Last sync6 hours agoUpstream changed yesterday · checked 60 seconds agoNext syncin 6 hoursLicenceCC-BY-4.0HealthFresh
Attribution & dataset
huggingface.co/…/leaderboard-dataset

Source: LMArena / arena.ai Leaderboard Dataset (lmarena-ai/leaderboard-dataset) on Hugging Face — https://huggingface.co/datasets/lmarena-ai/leaderboard-dataset. Licensed under CC BY 4.0 (https://creativecommons.org/licenses/by/4.0/). Modified by aiqbench: normalised into aiqbench's common board format; we ingest the latest snapshot of the 'text_to_image' config.

Arena · Text-to-Video

arena.ai (LMArena)
Entries48Last sync6 hours agoUpstream changed yesterday · checked 60 seconds agoNext syncin 6 hoursLicenceCC-BY-4.0HealthFresh
Attribution & dataset
huggingface.co/…/leaderboard-dataset

Source: LMArena / arena.ai Leaderboard Dataset (lmarena-ai/leaderboard-dataset) on Hugging Face — https://huggingface.co/datasets/lmarena-ai/leaderboard-dataset. Licensed under CC BY 4.0 (https://creativecommons.org/licenses/by/4.0/). Modified by aiqbench: normalised into aiqbench's common board format; we ingest the latest snapshot of the 'text_to_video' config.

Arena · Vision

arena.ai (LMArena)
Entries1,124Last sync6 hours agoUpstream changed yesterday · checked 60 seconds agoNext syncin 6 hoursLicenceCC-BY-4.0HealthFresh
Attribution & dataset
huggingface.co/…/leaderboard-dataset

Source: LMArena / arena.ai Leaderboard Dataset (lmarena-ai/leaderboard-dataset) on Hugging Face — https://huggingface.co/datasets/lmarena-ai/leaderboard-dataset. Licensed under CC BY 4.0 (https://creativecommons.org/licenses/by/4.0/). Modified by aiqbench: normalised into aiqbench's common board format; we ingest the latest snapshot of the 'vision_style_control' config.

Arena · WebDev

arena.ai (LMArena)
Entries1,165Last sync6 hours agoUpstream changed yesterday · checked 60 seconds agoNext syncin 6 hoursLicenceCC-BY-4.0HealthFresh
Attribution & dataset
huggingface.co/…/leaderboard-dataset

Source: LMArena / arena.ai Leaderboard Dataset (lmarena-ai/leaderboard-dataset) on Hugging Face — https://huggingface.co/datasets/lmarena-ai/leaderboard-dataset. Licensed under CC BY 4.0 (https://creativecommons.org/licenses/by/4.0/). Modified by aiqbench: normalised into aiqbench's common board format; we ingest the latest snapshot of the 'webdev' config.

BFCL v4 — function calling

Berkeley Function Calling Leaderboard (Gorilla, UC Berkeley)
Entries109Last sync6 hours agoUpstream changed 6 hours ago · checked 60 seconds agoNext syncin 6 hoursLicenceCC-BY-4.0HealthFresh
Attribution & dataset
huggingface.co/…/EEE_datastore

Source: Every Eval Ever datastore (EvalEval coalition), https://huggingface.co/datasets/evaleval/EEE_datastore, licensed CC BY 4.0 (https://creativecommons.org/licenses/by/4.0/). Underlying results published by Berkeley Function Calling Leaderboard (Gorilla, UC Berkeley) — https://gorilla.cs.berkeley.edu/leaderboard.html, converted into the EEE schema by the coalition's adapters. Modified by aiqbench: the 'bfcl' collection's headline result per model, normalised into aiqbench's common board format, proportions rescaled to percent.

BSEQ — largest connected qubit set (Metriq)

Metriq (Unitary Foundation) — metriq-gym runs
Entries16Last sync4 hours agoUpstream changed 4 days ago · checked 60 seconds agoNext syncin 20 hoursLicenceCC-BY-4.0HealthFresh
Attribution & dataset
github.com/…/metriq-data

Source: metriq-data (Unitary Foundation) — https://github.com/unitaryfoundation/metriq-data, licensed CC BY 4.0 (https://creativecommons.org/licenses/by/4.0/); hardware runs of the metriq-gym "BSEQ" benchmark (Apache 2.0) as published to Metriq (https://metriq.info). Modified by aiqbench: one row per device, the most recent eligible run, score = the largest number of qubits whose Bell-state effective-qubit (BSEQ) test passed. Runs on simulators are not ranked.

CLOPS — circuit layer operations per second (Metriq)

Metriq (Unitary Foundation) — metriq-gym runs
Entries8Last sync4 hours agoUpstream changed 4 days ago · checked 60 seconds agoNext syncin 20 hoursLicenceCC-BY-4.0HealthFresh
Attribution & dataset
github.com/…/metriq-data

Source: metriq-data (Unitary Foundation) — https://github.com/unitaryfoundation/metriq-data, licensed CC BY 4.0 (https://creativecommons.org/licenses/by/4.0/); hardware runs of the metriq-gym "CLOPS" benchmark (Apache 2.0) as published to Metriq (https://metriq.info). Modified by aiqbench: one row per device, the most recent eligible run, score = CLOPS as metriq-gym measures it (100 qubits, 100 layers, twirled). Only runs with num_qubits = 100, num_layers = 100 are ranked. Runs on simulators are not ranked.

Entangled-state and two-qubit gate error

awesome-quantum-computing-experiments (François-Marie Le Régent)
Entries34Last sync4 hours agoUpstream changed 4 days ago · checked 60 seconds agoNext syncin 20 hoursLicenceMITHealthFresh
Attribution & dataset
raw.githubusercontent.com/…/entangled_state_error_exp.csv

Source: Awesome Quantum Computing Experiments, François-Marie Le Régent, https://github.com/francois-marie/awesome-quantum-computing-experiments (data/entangled_state_error_exp.csv), MIT License (https://opensource.org/license/mit). Cite as: Le Régent, F.-M. (2025), "Awesome Quantum Computing Experiments: Benchmarking Experimental Progress Towards Fault-Tolerant Quantum Computation", https://arxiv.org/abs/2507.03678. Modified by aiqbench: one row per CSV record, ranked on the reported entangled-state or two-qubit gate error (lower is better); every column is kept in metadataJson.

EPLG — error per layered gate (Metriq)

Metriq (Unitary Foundation) — metriq-gym runs
Entries11Last sync4 hours agoUpstream changed 4 days ago · checked 60 seconds agoNext syncin 20 hoursLicenceCC-BY-4.0HealthFresh
Attribution & dataset
github.com/…/metriq-data

Source: metriq-data (Unitary Foundation) — https://github.com/unitaryfoundation/metriq-data, licensed CC BY 4.0 (https://creativecommons.org/licenses/by/4.0/); hardware runs of the metriq-gym "EPLG" benchmark (Apache 2.0) as published to Metriq (https://metriq.info). Modified by aiqbench: one row per device, the most recent eligible run, score = error per layered gate (EPLG) at the 100-qubit chain when the run measured it, otherwise at the longest chain length with a value; the chain length is recorded with every row and lower is better. Runs on simulators are not ranked.

FrontierMath

Epoch AI
Entries101Last sync56 seconds agoUpstream changed 60 seconds ago · checked 60 seconds agoNext syncin 12 hoursLicenceCC-BY-4.0HealthFresh
Attribution & dataset
epoch.ai/…/benchmark_data.zip

Source: Epoch AI, 'AI Benchmarking Hub'. Published online at epoch.ai. Retrieved from https://epoch.ai/benchmarks. Licensed under CC BY 4.0 (https://creativecommons.org/licenses/by/4.0/). Modified by aiqbench: normalised into aiqbench's common board format; we ingest the 'frontiermath.csv' table and rescale its 0-1 scores to percent. Evaluation run by Epoch AI.

GAIA (HAL)

Holistic Agent Leaderboard (Princeton)
Entries12Last sync6 hours agoUpstream changed 6 hours ago · checked 60 seconds agoNext syncin 6 hoursLicenceCC-BY-4.0HealthFresh
Attribution & dataset
huggingface.co/…/EEE_datastore

Source: Every Eval Ever datastore (EvalEval coalition), https://huggingface.co/datasets/evaleval/EEE_datastore, licensed CC BY 4.0 (https://creativecommons.org/licenses/by/4.0/). Underlying results published by Holistic Agent Leaderboard (Princeton) — https://hal.cs.princeton.edu/, converted into the EEE schema by the coalition's adapters. Modified by aiqbench: the 'hal-gaia' collection's headline result per model, normalised into aiqbench's common board format, proportions rescaled to percent.

GPQA Diamond

Epoch AI
Entries324Last sync56 seconds agoUpstream changed 60 seconds ago · checked 60 seconds agoNext syncin 12 hoursLicenceCC-BY-4.0HealthFresh
Attribution & dataset
epoch.ai/…/benchmark_data.zip

Source: Epoch AI, 'AI Benchmarking Hub'. Published online at epoch.ai. Retrieved from https://epoch.ai/benchmarks. Licensed under CC BY 4.0 (https://creativecommons.org/licenses/by/4.0/). Modified by aiqbench: normalised into aiqbench's common board format; we ingest the 'gpqa_diamond.csv' table and rescale its 0-1 scores to percent. Evaluation run by Epoch AI.

Humanity's Last Exam

Scale AI / CAIS
Entries56Last sync55 seconds agoUpstream changed 60 seconds ago · checked 60 seconds agoNext syncin 12 hoursLicenceCC-BY-4.0HealthFresh
Attribution & dataset
epoch.ai/…/benchmark_data.zip

Source: Epoch AI, 'AI Benchmarking Hub'. Published online at epoch.ai. Retrieved from https://epoch.ai/benchmarks. Licensed under CC BY 4.0 (https://creativecommons.org/licenses/by/4.0/). Modified by aiqbench: normalised into aiqbench's common board format; we ingest the 'hle_external.csv' table and rescale its 0-1 scores to percent. Underlying results published by Scale AI / CAIS — https://agi.safe.ai/, transcribed by Epoch AI.

IBM Quantum fleet — live systems

IBM Quantum Platform API
Entries0Last syncneverNext sync—LicenceLicenseRef-Vendor-APIHealthError

Last error: IBM_QUANTUM_API_KEY / IBM_QUANTUM_CRN unset

Attribution & dataset
quantum.cloud.ibm.com/…/backends

Source: IBM Quantum Platform API (https://quantum.cloud.ibm.com/api/v1/backends) — IBM's own published system facts for each quantum computer the instance can reach (physical qubit count, processor family, CLOPS, queue length) and its latest calibration (Qiskit BackendProperties), read through the vendor's REST API with an IBM Cloud account. The median two-qubit gate error, T1, T2 and readout error are medians over IBM's calibration data as published; not an aiqbench measurement. Score = physical qubits. Subject to IBM Quantum's terms of use.

IFBench (Artificial Analysis)

Artificial Analysis
Entries455Last sync11 hours agoUpstream changed 6 hours ago · checked 60 seconds agoNext syncin 36 minutesLicenceCC-BY-4.0HealthFresh
Attribution & dataset
huggingface.co/…/EEE_datastore

Source: Every Eval Ever datastore (EvalEval coalition), https://huggingface.co/datasets/evaleval/EEE_datastore, licensed CC BY 4.0 (https://creativecommons.org/licenses/by/4.0/). Underlying results published by Artificial Analysis — https://artificialanalysis.ai/, converted into the EEE schema by the coalition's adapters. Modified by aiqbench: the 'artificial-analysis-llms' collection's headline result per model, normalised into aiqbench's common board format, proportions rescaled to percent. Attribution to artificialanalysis.ai is required by their terms.

IonQ fleet — live backends

IonQ Quantum Cloud API
Entries6Last sync54 seconds agoUpstream changed 60 seconds ago · checked 60 seconds agoNext syncin 6 hoursLicenceLicenseRef-Vendor-APIHealthFresh
Attribution & dataset
api.ionq.co/…/backends

Source: IonQ Quantum Cloud API (https://api.ionq.co/v0.4/backends) — IonQ's own published system facts for each QPU (status, physical qubit count, queue time, native gate set, error-mitigation options), read through the public backends endpoint; with an API key, the vendor's characterization figures (fidelity, timing) as reported. Not an aiqbench measurement: the numbers are the vendor's, unmodified. Score = physical qubits. See https://docs.ionq.com for the API's terms.

Linear Ramp QAOA at 20 qubits (Metriq)

Metriq (Unitary Foundation) — metriq-gym runs
Entries15Last sync4 hours agoUpstream changed 4 days ago · checked 60 seconds agoNext syncin 20 hoursLicenceCC-BY-4.0HealthFresh
Attribution & dataset
github.com/…/metriq-data

Source: metriq-data (Unitary Foundation) — https://github.com/unitaryfoundation/metriq-data, licensed CC BY 4.0 (https://creativecommons.org/licenses/by/4.0/); hardware runs of the metriq-gym "Linear Ramp QAOA" benchmark (Apache 2.0) as published to Metriq (https://metriq.info). Modified by aiqbench: one row per device, the most recent eligible run, score = effective approximation ratio (metriq-gym's score: the approximation ratio rescaled against random sampling, 0 when not above it) on a 1-D graph at 20 qubits with p = 10 layers. Only runs with graph_type = "1D", num_qubits = 20, qaoa_layers = [10] are ranked. Runs on simulators are not ranked.

LiveBench (overall)

LiveBench
Entries339Last sync6 hours agoUpstream changed 6 hours ago · checked 60 seconds agoNext syncin 6 hoursLicenceCC-BY-4.0HealthFresh
Attribution & dataset
huggingface.co/…/EEE_datastore

Source: Every Eval Ever datastore (EvalEval coalition), https://huggingface.co/datasets/evaleval/EEE_datastore, licensed CC BY 4.0 (https://creativecommons.org/licenses/by/4.0/). Underlying results published by LiveBench — https://livebench.ai/, converted into the EEE schema by the coalition's adapters. Modified by aiqbench: the 'livebench' collection's headline result per model, normalised into aiqbench's common board format, proportions rescaled to percent.

LiveCodeBench (Artificial Analysis)

Artificial Analysis
Entries346Last sync11 hours agoUpstream changed 6 hours ago · checked 60 seconds agoNext syncin 36 minutesLicenceCC-BY-4.0HealthFresh
Attribution & dataset
huggingface.co/…/EEE_datastore

Source: Every Eval Ever datastore (EvalEval coalition), https://huggingface.co/datasets/evaleval/EEE_datastore, licensed CC BY 4.0 (https://creativecommons.org/licenses/by/4.0/). Underlying results published by Artificial Analysis — https://artificialanalysis.ai/, converted into the EEE schema by the coalition's adapters. Modified by aiqbench: the 'artificial-analysis-llms' collection's headline result per model, normalised into aiqbench's common board format, proportions rescaled to percent. Attribution to artificialanalysis.ai is required by their terms.

Mirror circuits polarization, 16 qubits × 32 layers (Metriq)

Metriq (Unitary Foundation) — metriq-gym runs
Entries14Last sync4 hours agoUpstream changed 4 days ago · checked 60 seconds agoNext syncin 20 hoursLicenceCC-BY-4.0HealthFresh
Attribution & dataset
github.com/…/metriq-data

Source: metriq-data (Unitary Foundation) — https://github.com/unitaryfoundation/metriq-data, licensed CC BY 4.0 (https://creativecommons.org/licenses/by/4.0/); hardware runs of the metriq-gym "Mirror Circuits" benchmark (Apache 2.0) as published to Metriq (https://metriq.info). Modified by aiqbench: one row per device, the most recent eligible run, score = the polarization (success probability rescaled so random guessing scores 0) of 16-qubit, 32-layer randomised mirror circuits. Only runs with width = 16, num_layers = 32 are ranked. Runs on simulators are not ranked.

MMLU-Pro (Artificial Analysis)

Artificial Analysis
Entries352Last sync11 hours agoUpstream changed 6 hours ago · checked 60 seconds agoNext syncin 54 minutesLicenceCC-BY-4.0HealthFresh
Attribution & dataset
huggingface.co/…/EEE_datastore

Source: Every Eval Ever datastore (EvalEval coalition), https://huggingface.co/datasets/evaleval/EEE_datastore, licensed CC BY 4.0 (https://creativecommons.org/licenses/by/4.0/). Underlying results published by Artificial Analysis — https://artificialanalysis.ai/, converted into the EEE schema by the coalition's adapters. Modified by aiqbench: the 'artificial-analysis-llms' collection's headline result per model, normalised into aiqbench's common board format, proportions rescaled to percent. Attribution to artificialanalysis.ai is required by their terms.

MMLU-Pro (TIGER-Lab)

TIGER-Lab (University of Waterloo)
Entries260Last sync6 hours agoUpstream changed Oct 8, 2026 · checked 60 seconds agoNext syncin 6 hoursLicenceApache-2.0HealthFresh
Attribution & dataset
huggingface.co/…/results.csv

Source: MMLU-Pro Leaderboard (TIGER-Lab, University of Waterloo) — https://huggingface.co/datasets/TIGER-Lab/mmlu_pro_leaderboard_submission. Licensed under Apache 2.0. Modified by aiqbench: we ingest the 'results.csv' file from the HF dataset root, rescale each row's Overall accuracy from 0-1 to percent, and preserve every disciplinary sub-score (Biology, Business, Chemistry, Computer Science, Economics, Engineering, Health, History, Law, Math, Philosophy, Physics, Psychology, Other) plus the Model Size and Data Source (TIGER-Lab vs Self-Reported) verbatim in each entry's metadata. Rows self-reported by model authors are labelled '(self-reported)' in the display name so readers can see the provenance without opening the details panel.

OTIS Mock AIME

Epoch AI
Entries304Last sync56 seconds agoUpstream changed 60 seconds ago · checked 60 seconds agoNext syncin 12 hoursLicenceCC-BY-4.0HealthFresh
Attribution & dataset
epoch.ai/…/benchmark_data.zip

Source: Epoch AI, 'AI Benchmarking Hub'. Published online at epoch.ai. Retrieved from https://epoch.ai/benchmarks. Licensed under CC BY 4.0 (https://creativecommons.org/licenses/by/4.0/). Modified by aiqbench: normalised into aiqbench's common board format; we ingest the 'otis_mock_aime_2024_2025.csv' table and rescale its 0-1 scores to percent. Evaluation run by Epoch AI.

Output speed, tokens/s (Artificial Analysis)

Artificial Analysis
Entries467Last sync11 hours agoUpstream changed 6 hours ago · checked 60 seconds agoNext syncin 36 minutesLicenceCC-BY-4.0HealthFresh
Attribution & dataset
huggingface.co/…/EEE_datastore

Source: Every Eval Ever datastore (EvalEval coalition), https://huggingface.co/datasets/evaleval/EEE_datastore, licensed CC BY 4.0 (https://creativecommons.org/licenses/by/4.0/). Underlying results published by Artificial Analysis — https://artificialanalysis.ai/, converted into the EEE schema by the coalition's adapters. Modified by aiqbench: the 'artificial-analysis-llms' collection's headline result per model, normalised into aiqbench's common board format. Median output tokens per second on the provider's API; attribution to artificialanalysis.ai is required by their terms.

Physical qubit coherence — T1

awesome-quantum-computing-experiments (François-Marie Le Régent)
Entries36Last sync4 hours agoUpstream changed 4 days ago · checked 60 seconds agoNext syncin 20 hoursLicenceMITHealthFresh
Attribution & dataset
raw.githubusercontent.com/…/physical_qubits.csv

Source: Awesome Quantum Computing Experiments, François-Marie Le Régent, https://github.com/francois-marie/awesome-quantum-computing-experiments (data/physical_qubits.csv), MIT License (https://opensource.org/license/mit). Cite as: Le Régent, F.-M. (2025), "Awesome Quantum Computing Experiments: Benchmarking Experimental Progress Towards Fault-Tolerant Quantum Computation", https://arxiv.org/abs/2507.03678. Modified by aiqbench: one row per CSV record, ranked on the energy-relaxation time T1, converted from seconds to microseconds (T2 kept alongside); every column is kept in metadataJson.

Physical qubit count records

awesome-quantum-computing-experiments (François-Marie Le Régent)
Entries27Last sync4 hours agoUpstream changed 4 days ago · checked 60 seconds agoNext syncin 20 hoursLicenceMITHealthFresh
Attribution & dataset
raw.githubusercontent.com/…/qubit_count.csv

Source: Awesome Quantum Computing Experiments, François-Marie Le Régent, https://github.com/francois-marie/awesome-quantum-computing-experiments (data/qubit_count.csv), MIT License (https://opensource.org/license/mit). Cite as: Le Régent, F.-M. (2025), "Awesome Quantum Computing Experiments: Benchmarking Experimental Progress Towards Fault-Tolerant Quantum Computation", https://arxiv.org/abs/2507.03678. Modified by aiqbench: one row per CSV record, ranked on the number of physical qubits controlled or entangled; every column is kept in metadataJson.

QED-C circuits on hardware (metriq-data)

metriq-data (Unitary Foundation) · QED-C QFT circuit
Entries10Last sync4 days agoUpstream changed Oct 8, 2026 · checked 60 seconds agoNext syncin 3 daysLicenceCC-BY-4.0HealthFresh
Attribution & dataset
api.github.com/…/main

Source: metriq-data (Unitary Foundation) — https://github.com/unitaryfoundation/metriq-data, licensed CC BY 4.0; hardware runs of the QED-C Quantum Fourier Transform circuit executed with metriq-gym (Apache 2.0), which wraps the QED-C application-oriented benchmark harness (SRI-International/QC-App-Oriented-Benchmarks, Apache 2.0). Modified by aiqbench: one row per device, the most recent run that matches one protocol — QFT swept over 4, 8 and 12 qubits, 3 circuits per width, 1000 shots, method 1, no error mitigation. Score = metriq-gym accuracy_score (mean circuit fidelity across the sweep, 0–1). Where a vendor uploaded three single-width runs on one day instead of a sweep, the same mean and pooled uncertainty are computed from them and the row is marked derived. Runs with other widths or parameters are not ranked.

QML Kernel accuracy at 20 qubits (Metriq)

Metriq (Unitary Foundation) — metriq-gym runs
Entries15Last sync4 hours agoUpstream changed 4 days ago · checked 60 seconds agoNext syncin 20 hoursLicenceCC-BY-4.0HealthFresh
Attribution & dataset
github.com/…/metriq-data

Source: metriq-data (Unitary Foundation) — https://github.com/unitaryfoundation/metriq-data, licensed CC BY 4.0 (https://creativecommons.org/licenses/by/4.0/); hardware runs of the metriq-gym "QML Kernel" benchmark (Apache 2.0) as published to Metriq (https://metriq.info). Modified by aiqbench: one row per device, the most recent eligible run, score = quantum-kernel classification accuracy (0–1) at 20 qubits, 1000 shots. Only runs with num_qubits = 20 are ranked. Runs on simulators are not ranked.

Quantum Advantage — Classically-Verifiable Problems

Quantum Advantage Tracker
Entries14Last sync11 minutes agoUpstream changed 6 days ago · checked 60 seconds agoNext syncin 12 hoursLicenceApache-2.0HealthFresh
Attribution & dataset
raw.githubusercontent.com/…/submissions.json

Source: Quantum Advantage Tracker (quantum-advantage-tracker/quantum-advantage-tracker.github.io) — https://quantum-advantage-tracker.github.io/. Licensed under Apache 2.0. Modified by aiqbench: we ingest the 'CVP' pathway's submissions.json verbatim, one LeaderboardEntry per submission. Cross-instance comparisons are NOT meaningful per QAT's editorial policy — the panel groups by instance and refuses to rank across instances. Rich per-submission fields (runtime, compute resources) are not stored; each entry links back to its GitHub issue for full provenance.

Quantum Advantage — Observable Estimations

Quantum Advantage Tracker
Entries19Last sync11 minutes agoUpstream changed 6 days ago · checked 60 seconds agoNext syncin 12 hoursLicenceApache-2.0HealthFresh
Attribution & dataset
raw.githubusercontent.com/…/submissions.json

Source: Quantum Advantage Tracker (quantum-advantage-tracker/quantum-advantage-tracker.github.io) — https://quantum-advantage-tracker.github.io/. Licensed under Apache 2.0. Modified by aiqbench: we ingest the 'OE' pathway's submissions.json verbatim, one LeaderboardEntry per submission. Cross-instance comparisons are NOT meaningful per QAT's editorial policy — the panel groups by instance and refuses to rank across instances. Rich per-submission fields (runtime, compute resources) are not stored; each entry links back to its GitHub issue for full provenance.

Quantum Advantage — Variational Problems

Quantum Advantage Tracker
Entries17Last sync11 minutes agoUpstream changed 6 days ago · checked 60 seconds agoNext syncin 12 hoursLicenceApache-2.0HealthFresh
Attribution & dataset
raw.githubusercontent.com/…/submissions.json

Source: Quantum Advantage Tracker (quantum-advantage-tracker/quantum-advantage-tracker.github.io) — https://quantum-advantage-tracker.github.io/. Licensed under Apache 2.0. Modified by aiqbench: we ingest the 'VP' pathway's submissions.json verbatim, one LeaderboardEntry per submission. Cross-instance comparisons are NOT meaningful per QAT's editorial policy — the panel groups by instance and refuses to rank across instances. Rich per-submission fields (runtime, compute resources) are not stored; each entry links back to its GitHub issue for full provenance.

Quantum error correction experiments — code distance

awesome-quantum-computing-experiments (François-Marie Le Régent)
Entries61Last sync4 hours agoUpstream changed 4 days ago · checked 60 seconds agoNext syncin 20 hoursLicenceMITHealthFresh
Attribution & dataset
raw.githubusercontent.com/…/qec_exp.csv

Source: Awesome Quantum Computing Experiments, François-Marie Le Régent, https://github.com/francois-marie/awesome-quantum-computing-experiments (data/qec_exp.csv), MIT License (https://opensource.org/license/mit). Cite as: Le Régent, F.-M. (2025), "Awesome Quantum Computing Experiments: Benchmarking Experimental Progress Towards Fault-Tolerant Quantum Computation", https://arxiv.org/abs/2507.03678. Modified by aiqbench: one row per CSV record, ranked on the largest code distance d demonstrated, parsed from the [[n,k,d]] code parameters; every column is kept in metadataJson.

Quantum processors (Wikipedia)

Wikipedia
Entries100Last sync4 hours agoUpstream changed 4 days ago · checked 60 seconds agoNext syncin 20 hoursLicenceCC-BY-SA-4.0HealthFresh
Attribution & dataset
en.wikipedia.org/…/api.php

Source: Wikipedia, List of quantum processors, CC BY-SA 4.0 — https://en.wikipedia.org/wiki/List_of_quantum_processors (https://creativecommons.org/licenses/by-sa/4.0/). Modified by aiqbench: the table was read from the page's wikitext through the MediaWiki API, references and formatting removed, and each row normalised into aiqbench's common board format with the physical qubit count as the score. The page revision each row was read from is recorded on the row.

Quantum volume records (Wikipedia)

Wikipedia
Entries24Last sync4 hours agoUpstream changed 4 days ago · checked 60 seconds agoNext syncin 20 hoursLicenceCC-BY-SA-4.0HealthFresh
Attribution & dataset
en.wikipedia.org/…/api.php

Source: Wikipedia, Quantum volume, CC BY-SA 4.0 — https://en.wikipedia.org/wiki/Quantum_volume (https://creativecommons.org/licenses/by-sa/4.0/). Modified by aiqbench: the table was read from the page's wikitext through the MediaWiki API, references and formatting removed, and each row normalised into aiqbench's common board format with log2 of the achieved quantum volume as the score. The page revision each row was read from is recorded on the row.

SimpleBench

SimpleBench
Entries102Last sync55 seconds agoUpstream changed 60 seconds ago · checked 60 seconds agoNext syncin 12 hoursLicenceCC-BY-4.0HealthFresh
Attribution & dataset
epoch.ai/…/benchmark_data.zip

Source: Epoch AI, 'AI Benchmarking Hub'. Published online at epoch.ai. Retrieved from https://epoch.ai/benchmarks. Licensed under CC BY 4.0 (https://creativecommons.org/licenses/by/4.0/). Modified by aiqbench: normalised into aiqbench's common board format; we ingest the 'simplebench_external.csv' table and rescale its 0-1 scores to percent. Underlying results published by SimpleBench — https://simple-bench.com/, transcribed by Epoch AI.

SimpleQA Verified

Epoch AI
Entries91Last sync56 seconds agoUpstream changed 60 seconds ago · checked 60 seconds agoNext syncin 12 hoursLicenceCC-BY-4.0HealthFresh
Attribution & dataset
epoch.ai/…/benchmark_data.zip

Source: Epoch AI, 'AI Benchmarking Hub'. Published online at epoch.ai. Retrieved from https://epoch.ai/benchmarks. Licensed under CC BY 4.0 (https://creativecommons.org/licenses/by/4.0/). Modified by aiqbench: normalised into aiqbench's common board format; we ingest the 'simpleqa_verified.csv' table and rescale its 0-1 scores to percent. Evaluation run by Epoch AI.

SWE-bench Verified

Epoch AI
Entries35Last sync56 seconds agoUpstream changed 60 seconds ago · checked 60 seconds agoNext syncin 12 hoursLicenceCC-BY-4.0HealthFresh
Attribution & dataset
epoch.ai/…/benchmark_data.zip

Source: Epoch AI, 'AI Benchmarking Hub'. Published online at epoch.ai. Retrieved from https://epoch.ai/benchmarks. Licensed under CC BY 4.0 (https://creativecommons.org/licenses/by/4.0/). Modified by aiqbench: normalised into aiqbench's common board format; we ingest the 'swe_bench_verified.csv' table and rescale its 0-1 scores to percent. Evaluation run by Epoch AI.

SWE-bench Verified (live board)

SWE-bench Verified leaderboard
Entries85Last sync6 hours agoUpstream changed 6 hours ago · checked 60 seconds agoNext syncin 6 hoursLicenceCC-BY-4.0HealthFresh
Attribution & dataset
huggingface.co/…/EEE_datastore

Source: Every Eval Ever datastore (EvalEval coalition), https://huggingface.co/datasets/evaleval/EEE_datastore, licensed CC BY 4.0 (https://creativecommons.org/licenses/by/4.0/). Underlying results published by SWE-bench Verified leaderboard — https://www.swebench.com/, converted into the EEE schema by the coalition's adapters. Modified by aiqbench: the 'swe-bench-verified-leaderboard' collection's headline result per model, normalised into aiqbench's common board format, proportions rescaled to percent.

Terminal-Bench

Terminal-Bench (Laude Institute)
Entries202Last sync55 seconds agoUpstream changed 60 seconds ago · checked 60 seconds agoNext syncin 12 hoursLicenceCC-BY-4.0HealthFresh
Attribution & dataset
epoch.ai/…/benchmark_data.zip

Source: Epoch AI, 'AI Benchmarking Hub'. Published online at epoch.ai. Retrieved from https://epoch.ai/benchmarks. Licensed under CC BY 4.0 (https://creativecommons.org/licenses/by/4.0/). Modified by aiqbench: normalised into aiqbench's common board format; we ingest the 'terminalbench_external.csv' table and rescale its 0-1 scores to percent. Underlying results published by Terminal-Bench (Laude Institute) — https://www.tbench.ai/leaderboard, transcribed by Epoch AI.

Terminal-Bench 4.0

Terminal-Bench 4.0 (Harbor / Laude Institute)
Entries23Last sync6 hours agoUpstream changed 6 hours ago · checked 60 seconds agoNext syncin 6 hoursLicenceCC-BY-4.0HealthFresh
Attribution & dataset
huggingface.co/…/EEE_datastore

Source: Every Eval Ever datastore (EvalEval coalition), https://huggingface.co/datasets/evaleval/EEE_datastore, licensed CC BY 4.0 (https://creativecommons.org/licenses/by/4.0/). Underlying results published by Terminal-Bench 4.0 (Harbor / Laude Institute) — https://www.tbench.ai/leaderboard, converted into the EEE schema by the coalition's adapters. Modified by aiqbench: the 'terminal-bench-4.0' collection's headline result per model, normalised into aiqbench's common board format, proportions rescaled to percent.

USACO (HAL)

Holistic Agent Leaderboard (Princeton)
Entries9Last sync6 hours agoUpstream changed 6 hours ago · checked 60 seconds agoNext syncin 6 hoursLicenceCC-BY-4.0HealthFresh
Attribution & dataset
huggingface.co/…/EEE_datastore

Source: Every Eval Ever datastore (EvalEval coalition), https://huggingface.co/datasets/evaleval/EEE_datastore, licensed CC BY 4.0 (https://creativecommons.org/licenses/by/4.0/). Underlying results published by Holistic Agent Leaderboard (Princeton) — https://hal.cs.princeton.edu/, converted into the EEE schema by the coalition's adapters. Modified by aiqbench: the 'hal-usaco' collection's headline result per model, normalised into aiqbench's common board format, proportions rescaled to percent.

Vectara HHEM Hallucination Leaderboard

Vectara
Entries109Last sync6 hours agoUpstream changed yesterday · checked 60 seconds agoNext syncin 6 hoursLicenceApache-2.0HealthFresh
Attribution & dataset
raw.githubusercontent.com/…/README.md

Source: Vectara Hallucination Leaderboard (vectara/hallucination-leaderboard) — https://github.com/vectara/hallucination-leaderboard. Licensed under Apache 2.0. Modified by aiqbench: we parse the ranking table embedded in the repo README between the <!-- LEADERBOARD_START --> and <!-- LEADERBOARD_END --> markers, and store factual-consistency-rate (100 − hallucination rate) as the primary score so "higher is better" holds across every board in the app. The raw hallucination rate, answer rate, and average summary length are preserved on each row in metadata.

WIT witness expectation at 7 qubits (Metriq)

Metriq (Unitary Foundation) — metriq-gym runs
Entries15Last sync4 hours agoUpstream changed 4 days ago · checked 60 seconds agoNext syncin 20 hoursLicenceCC-BY-4.0HealthFresh
Attribution & dataset
github.com/…/metriq-data

Source: metriq-data (Unitary Foundation) — https://github.com/unitaryfoundation/metriq-data, licensed CC BY 4.0 (https://creativecommons.org/licenses/by/4.0/); hardware runs of the metriq-gym "WIT" benchmark (Apache 2.0) as published to Metriq (https://metriq.info). Modified by aiqbench: one row per device, the most recent eligible run, score = the witness expectation value (0–1) of the 7-qubit WIT circuit. Only runs with num_qubits = 7 are ranked. Runs on simulators are not ranked.

τ²-bench Airline

τ²-bench via the Exgentic Open Agent Leaderboard
Entries3Last sync6 hours agoUpstream changed 6 hours ago · checked 60 seconds agoNext syncin 6 hoursLicenceCC-BY-4.0HealthFresh
Attribution & dataset
huggingface.co/…/EEE_datastore

Source: Every Eval Ever datastore (EvalEval coalition), https://huggingface.co/datasets/evaleval/EEE_datastore, licensed CC BY 4.0 (https://creativecommons.org/licenses/by/4.0/). Underlying results published by τ²-bench via the Exgentic Open Agent Leaderboard — https://github.com/sierra-research/tau2-bench, converted into the EEE schema by the coalition's adapters. Modified by aiqbench: the 'tau-bench-2_airline' collection's headline result per model, normalised into aiqbench's common board format, proportions rescaled to percent.

τ²-bench Retail

τ²-bench via the Exgentic Open Agent Leaderboard
Entries3Last sync6 hours agoUpstream changed 6 hours ago · checked 60 seconds agoNext syncin 6 hoursLicenceCC-BY-4.0HealthFresh
Attribution & dataset
huggingface.co/…/EEE_datastore

Source: Every Eval Ever datastore (EvalEval coalition), https://huggingface.co/datasets/evaleval/EEE_datastore, licensed CC BY 4.0 (https://creativecommons.org/licenses/by/4.0/). Underlying results published by τ²-bench via the Exgentic Open Agent Leaderboard — https://github.com/sierra-research/tau2-bench, converted into the EEE schema by the coalition's adapters. Modified by aiqbench: the 'tau-bench-2_retail' collection's headline result per model, normalised into aiqbench's common board format, proportions rescaled to percent.

τ²-bench Telecom

τ²-bench via the Exgentic Open Agent Leaderboard
Entries3Last sync6 hours agoUpstream changed 6 hours ago · checked 60 seconds agoNext syncin 6 hoursLicenceCC-BY-4.0HealthFresh
Attribution & dataset
huggingface.co/…/EEE_datastore

Source: Every Eval Ever datastore (EvalEval coalition), https://huggingface.co/datasets/evaleval/EEE_datastore, licensed CC BY 4.0 (https://creativecommons.org/licenses/by/4.0/). Underlying results published by τ²-bench via the Exgentic Open Agent Leaderboard — https://github.com/sierra-research/tau2-bench, converted into the EEE schema by the coalition's adapters. Modified by aiqbench: the 'tau-bench-2_telecom' collection's headline result per model, normalised into aiqbench's common board format, proportions rescaled to percent.