← Benchmark report cards
Agentic
SWE-bench Verified (live board)
Published by SWE-bench Verified leaderboard. Source page ↗ · Data we read ↗
The swebench.com board: submissions by labs and agent authors, verified by the maintainers.
Facts
| Fact | Value | Where it comes from |
|---|---|---|
| Who runs the evaluation | a university group | curated by aiqbench, reviewed 2026-10-09 |
| Test set exposure | public | curated by aiqbench, reviewed 2026-10-09 |
| Data licence | CC-BY-4.0 | the board's attribution record |
| Newest published result | Sep 1, 2026 | the ingested rows |
| Last pulled by aiqbench | 9 hours ago · every 12 h | the sync log |
| Models on this axis | 85 | the ingested rows |
| Rows with a published interval | none published | the ingested rows |
| Headroom at the top | Best 79.2%, 20.8% below the ceiling; top 10 within 4.6%. | computed from the ingested rows |
| Axes it tracks closely | None measured yet: 46 pairs are under the shared-model floor. | Spearman ρ over shared models (see Clusters) |
Where it appears
Weighted in the built-in templates: All sources ×1.
View this axis alone in the console →Attribution
Source: Every Eval Ever datastore (EvalEval coalition), https://huggingface.co/datasets/evaleval/EEE_datastore, licensed CC BY 4.0 (https://creativecommons.org/licenses/by/4.0/). Underlying results published by SWE-bench Verified leaderboard — https://www.swebench.com/, converted into the EEE schema by the coalition's adapters. Modified by aiqbench: the 'swe-bench-verified-leaderboard' collection's headline result per model, normalised into aiqbench's common board format, proportions rescaled to percent.