Skip to content

Benchmarks

Sources
8
Entries tracked
22,308
Last sync
10 min
All sources syncing normally
  • Arena · Text9 hours ago
  • Arena · WebDev9 hours ago
  • Arena · Vision9 hours ago
  • Arena · Agent9 hours ago
  • GPQA Diamond10 minutes ago
  • SWE-bench10 minutes ago
  • Terminal-Bench10 minutes ago
  • ARC-AGI-210 minutes ago

o1-2024-12-17

73.3%±6.7%

66.7%CI80.0%

OpenAIDec 2024swing #127–#229

AIME (math) ×13 of 200 models
ModelOrg± CISwingAdd to compare
93o1-2024-12-17OpenAIDec 2024$15 / $6073.3%66.7%–80.0%#127–229
127o1-mini-2024-09-12OpenAISep 2024—46.9%40.5%–53.4%#185–760
135o1-preview-2024-09-12OpenAISep 2024—31.1%24.1%–38.1%#147–314

Showing AIME (math) exactly as the source published it — its own score and confidence interval, no blending. Select a second axis to build a weighted composite.

The few things in AI and quantum that actually mattered this week — honestly summarised.

One email a week. Unsubscribe in one click. No tracking, no sharing.