Skip to content

Benchmarks

Sources
8
Entries tracked
22,308
Last sync
10 min
All sources syncing normally
  • Arena · Text9 hours ago
  • Arena · WebDev9 hours ago
  • Arena · Vision9 hours ago
  • Arena · Agent9 hours ago
  • GPQA Diamond10 minutes ago
  • SWE-bench10 minutes ago
  • Terminal-Bench10 minutes ago
  • ARC-AGI-210 minutes ago

o1-2024-12-17

8.0%±1.1%

6.9%CI9.0%

OpenAIDec 2024swing #127–#229

Humanity's Last Exam ×12 of 46 models
ModelOrg± CISwingAdd to compare
33o1-pro-2025-03-19OpenAIDec 2024$150 / $6008.1%7.0%–9.2%#290–558
35o1-2024-12-17OpenAIDec 2024$15 / $608.0%6.9%–9.0%#127–229

Showing Humanity's Last Exam exactly as the source published it — its own score and confidence interval, no blending. Select a second axis to build a weighted composite.

The few things in AI and quantum that actually mattered this week — honestly summarised.

One email a week. Unsubscribe in one click. No tracking, no sharing.