Skip to content

Benchmarks

Sources
8
Entries tracked
22,310
Last sync
1 min
All sources syncing normally
  • Arena · Text8 hours ago
  • Arena · WebDev8 hours ago
  • Arena · Vision8 hours ago
  • Arena · Agent8 hours ago
  • GPQA Diamond1 minute ago
  • SWE-bench1 minute ago
  • Terminal-Bench1 minute ago
  • ARC-AGI-21 minute ago

OpenHands

57±0

56interval57

swing #227–#227

Overall ×1WebDev Arena ×1Vision Arena ×1Factuality Arena ×1Search Arena ×1Document Arena ×1Agent Arena ×1GPQA Diamond ×1AIME (math) ×1FrontierMath ×1SimpleQA Verified ×1ARC-AGI-2 ×1Humanity's Last Exam ×1SimpleBench ×1LiveBench ×1BFCL v4 (function calling) ×1dormantSWE-bench Verified (live board) ×1Terminal-Bench 4.0 ×1MMLU-Pro (Artificial Analysis) ×1LiveCodeBench (Artificial Analysis) ×1IFBench (Artificial Analysis) ×1HHEM Hallucination (Vectara) ×14 of 1034 models
ModelOrgIntervalSwingiiiiiiiiiiiiiiiiiiiiiiAdd to compare
11020251127_openhands_claude-opus-4-5———61.7 96.9Ranked 61.7 = (1 × 96.9 + 3 × 50) ÷ 4. 96.9 is the mean percentile over the 1 of 22 selected axes this model is measured on; fewer axes means a stronger pull toward 50.——1/22low—————————————————97—————
227OpenHands———56.7 76.9Ranked 56.7 = (1 × 76.9 + 3 × 50) ÷ 4. 76.9 is the mean percentile over the 1 of 22 selected axes this model is measured on; fewer axes means a stronger pull toward 50.——1/22low—————————————————77—————
322OpenHands + 4x Scaled (2024-02-03)———53.3 63.1Ranked 53.3 = (1 × 63.1 + 3 × 50) ÷ 4. 63.1 is the mean percentile over the 1 of 22 selected axes this model is measured on; fewer axes means a stronger pull toward 50.——1/22low—————————————————63—————
431OpenHands + CodeAct v2.1 (claude-3-5-sonnet-20241022)———49.4 47.7Ranked 49.4 = (1 × 47.7 + 3 × 50) ÷ 4. 47.7 is the mean percentile over the 1 of 22 selected axes this model is measured on; fewer axes means a stronger pull toward 50.——1/22low—————————————————48—————

Blend is coverage-shrunk; the raw composite is shown greyed beside it · A low badge means fewer than 3 boards scored this model

The few things in AI and quantum that actually mattered this week — honestly summarised.

One email a week. Unsubscribe in one click. No tracking, no sharing.