Skip to content

Benchmarks

Sources
8
Entries tracked
22,308
Last sync
34 min
All sources syncing normally
  • Arena · Text34 minutes ago
  • Arena · WebDev34 minutes ago
  • Arena · Vision34 minutes ago
  • Arena · Agent34 minutes ago
  • GPQA Diamond58 minutes ago
  • SWE-bench58 minutes ago
  • Terminal-Bench58 minutes ago
  • ARC-AGI-258 minutes ago

o1-preview

55±1

54interval56

openaiSep 2024swing #147–#314

Overall ×1WebDev Arena ×1Vision Arena ×1Factuality Arena ×1Search Arena ×1Document Arena ×1Agent Arena ×1GPQA Diamond ×1AIME (math) ×1FrontierMath ×1SimpleQA Verified ×1ARC-AGI-2 ×1Humanity's Last Exam ×1SimpleBench ×1LiveBench ×1BFCL v4 (function calling) ×1dormantSWE-bench Verified (live board) ×1Terminal-Bench 4.0 ×1MMLU-Pro (Artificial Analysis) ×1LiveCodeBench (Artificial Analysis) ×1IFBench (Artificial Analysis) ×1HHEM Hallucination (Vectara) ×11 of 1034 models
ModelOrgIntervalSwingiiiiiiiiiiiiiiiiiiiiiiAdd to compare
277o1-previewopenaiSep 2024—55.1 57.2Ranked 55.1 = (7 × 57.2 + 3 × 50) ÷ 10. 57.2 is the mean percentile over the 7 of 22 selected axes this model is measured on; fewer axes means a stronger pull toward 50.54–56567/22#147–31459——————3534————3875—71—90———

Blend is coverage-shrunk; the raw composite is shown greyed beside it · A low badge means fewer than 3 boards scored this model

The few things in AI and quantum that actually mattered this week — honestly summarised.

One email a week. Unsubscribe in one click. No tracking, no sharing.