Skip to content

Benchmarks

Sources
8
Entries tracked
22,308
Last sync
25 min
All sources syncing normally
  • Arena · Text9 hours ago
  • Arena · WebDev9 hours ago
  • Arena · Vision9 hours ago
  • Arena · Agent9 hours ago
  • GPQA Diamond26 minutes ago
  • SWE-bench25 minutes ago
  • Terminal-Bench25 minutes ago
  • ARC-AGI-225 minutes ago

gemma-2-9b-it

29±1

28interval30

googleJun 2024swing #301–#1011

Overall ×1WebDev Arena ×1Vision Arena ×1Factuality Arena ×1Search Arena ×1Document Arena ×1Agent Arena ×1GPQA Diamond ×1AIME (math) ×1FrontierMath ×1SimpleQA Verified ×1ARC-AGI-2 ×1Humanity's Last Exam ×1SimpleBench ×1LiveBench ×1BFCL v4 (function calling) ×1dormantSWE-bench Verified (live board) ×1Terminal-Bench 4.0 ×1MMLU-Pro (Artificial Analysis) ×1LiveCodeBench (Artificial Analysis) ×1IFBench (Artificial Analysis) ×1HHEM Hallucination (Vectara) ×12 of 1034 models
ModelOrgIntervalSwingiiiiiiiiiiiiiiiiiiiiiiAdd to compare
591gemma-2-9b-it-simpo—Jul 2024—44.7 28.8Ranked 44.7 = (1 × 28.8 + 3 × 50) ÷ 4. 28.8 is the mean percentile over the 1 of 22 selected axes this model is measured on; fewer axes means a stronger pull toward 50.44–46—1/22low#292–59129—————————————————————
1011gemma-2-9b-itgoogleJun 2024—29.1 13.4Ranked 29.1 = (4 × 13.4 + 3 × 50) ÷ 7. 13.4 is the mean percentile over the 4 of 22 selected axes this model is measured on; fewer axes means a stronger pull toward 50.28–30234/22#301–101126——————83—————16———————

Blend is coverage-shrunk; the raw composite is shown greyed beside it · A low badge means fewer than 3 boards scored this model

The few things in AI and quantum that actually mattered this week — honestly summarised.

One email a week. Unsubscribe in one click. No tracking, no sharing.