Measured benchmarks
MMLU-Pro (Artificial Analysis)
Published by Artificial Analysis. Source page ↗ · Data we read ↗
Artificial Analysis runs the public benchmark on hosted endpoints.
Facts
| Fact | Value | Where it comes from |
|---|---|---|
| Who runs the evaluation | an independent organisation | curated by aiqbench, reviewed 2026-10-09 |
| Test set exposure | public | curated by aiqbench, reviewed 2026-10-09 |
| Data licence | CC-BY-4.0 | the board's attribution record |
| Newest published result | 2 days ago | the ingested rows |
| Last pulled by aiqbench | 14 hours ago · every 12 h | the sync log |
| Models on this axis | 352 | the ingested rows |
| Rows with a published interval | none published | the ingested rows |
| Headroom at the top | Best 89.8%, 10.2% below the ceiling; top 10 within 2.4%. | computed from the ingested rows |
| Axes it tracks closely |
| Spearman ρ over shared models (see Clusters) |
Where it appears
Weighted in the built-in templates: All sources ×1.
View this axis alone in the console →Attribution
Source: Every Eval Ever datastore (EvalEval coalition), https://huggingface.co/datasets/evaleval/EEE_datastore, licensed CC BY 4.0 (https://creativecommons.org/licenses/by/4.0/). Underlying results published by Artificial Analysis — https://artificialanalysis.ai/, converted into the EEE schema by the coalition's adapters. Modified by aiqbench: the 'artificial-analysis-llms' collection's headline result per model, normalised into aiqbench's common board format, proportions rescaled to percent. Attribution to artificialanalysis.ai is required by their terms.