Skip to content

Benchmarks

Sources
8
Entries tracked
22,318
Last sync
32 min
All sources syncing normally
  • Arena · Text3 hours ago
  • Arena · WebDev3 hours ago
  • Arena · Vision3 hours ago
  • Arena · Agent3 hours ago
  • GPQA Diamond32 minutes ago
  • SWE-bench32 minutes ago
  • Terminal-Bench32 minutes ago
  • ARC-AGI-232 minutes ago

Mistral Medium 3

49±0

48interval49

mistralswing #467–#467

Mistral Medium 3.1

46±0

46interval47

mistralswing #536–#536

Overall ×1WebDev Arena ×1Vision Arena ×1Factuality Arena ×1Search Arena ×1Document Arena ×1Agent Arena ×1GPQA Diamond ×1AIME (math) ×1FrontierMath ×1SimpleQA Verified ×1ARC-AGI-2 ×1Humanity's Last Exam ×1SimpleBench ×1LiveBench ×1BFCL v4 (function calling) ×1dormantSWE-bench Verified (live board) ×1Terminal-Bench 4.0 ×1MMLU-Pro (Artificial Analysis) ×1LiveCodeBench (Artificial Analysis) ×1IFBench (Artificial Analysis) ×1HHEM Hallucination (Vectara) ×16 of 1034 models
ModelOrgIntervalSwingiiiiiiiiiiiiiiiiiiiiiiAdd to compare
467Mistral Medium 3mistral—$0.40 / $248.7 47.3Ranked 48.7 = (3 × 47.3 + 3 × 50) ÷ 6. 47.3 is the mean percentile over the 3 of 22 selected axes this model is measured on; fewer axes means a stronger pull toward 50.—153/22———————————————————544939—
536Mistral Medium 3.1mistral—$0.40 / $246.3 42.6Ranked 46.3 = (3 × 42.6 + 3 × 50) ÷ 6. 42.6 is the mean percentile over the 3 of 22 selected axes this model is measured on; fewer axes means a stronger pull toward 50.—143/22———————————————————375041—
553mistral-medium-3.5mistralAug 2025$1.50 / $7.5045.7 43.6Ranked 45.7 = (6 × 43.6 + 3 × 50) ÷ 9. 43.6 is the mean percentile over the 6 of 22 selected axes this model is measured on; fewer axes means a stronger pull toward 50.43–48736/22#110–55374154739——7—————————————80—
716mistral-medium-2508mistralAug 2025—41.6 35.2Ranked 41.6 = (4 × 35.2 + 3 × 50) ÷ 7. 35.2 is the mean percentile over the 4 of 22 selected axes this model is measured on; fewer axes means a stronger pull toward 50.40–43614/22#109–71665—3538—————————————————4
782mistral-medium-2505mistralMay 2025—39.9 36.2Ranked 39.9 = (8 × 36.2 + 3 × 50) ÷ 11. 36.2 is the mean percentile over the 8 of 22 selected axes this model is measured on; fewer axes means a stronger pull toward 50.37–42498/22#133–78258—33————42349——11—4557——————
970mistral-mediummistralOct 2026—32.9 15.7Ranked 32.9 = (3 × 15.7 + 3 × 50) ÷ 6. 15.7 is the mean percentile over the 3 of 22 selected axes this model is measured on; fewer axes means a stronger pull toward 50.32–3493/22#317–97020—————————————————1710——

Blend is coverage-shrunk; the raw composite is shown greyed beside it · A low badge means fewer than 3 boards scored this model

The few things in AI and quantum that actually mattered this week — honestly summarised.

One email a week. Unsubscribe in one click. No tracking, no sharing.