xAI · model passport
Grok 3
grok-3- Best percentile
- 79.0HHEM Hallucination (Vectara)
- Composite standing
- 49.0shrunk · 7/27 axes
What the data says
Benchmarked on 7 of 27 tracked axes. Every figure below is the model's own published result on that board.
Weakest axes
- 11.2 pct — ARC-AGI-2 (0.0%)
Uneven: 67.8 percentile points between its best and worst axis — 79 pct on HHEM Hallucination (Vectara) versus 11.2 pct on ARC-AGI-2.
- HHEM Hallucination (Vectara)79 pct94.2%Verify →
- MMLU-Pro (Artificial Analysis)66.7 pct79.9%Verify →
- IFBench (Artificial Analysis)53.1 pct46.9%Verify →
- LiveCodeBench (Artificial Analysis)51.9 pct42.5%Verify →
- LiveBench48.1 pct52.6%Verify →
- SimpleBench29.9 pct36.1%Verify →
- ARC-AGI-211.2 pct0.0%Verify →
- OverallNot benchmarked
- WebDev ArenaNot benchmarked
- Vision ArenaNot benchmarked
- Factuality ArenaNot benchmarked
- Search ArenaNot benchmarked
- Document ArenaNot benchmarked
- Agent ArenaNot benchmarked
- GPQA DiamondNot benchmarked
- AIME (math)Not benchmarked
- FrontierMathNot benchmarked
- SimpleQA VerifiedNot benchmarked
- Humanity's Last ExamNot benchmarked
- BFCL v4 (function calling)Not benchmarked
- SWE-bench Verified (live board)Not benchmarked
- Terminal-Bench 4.0Not benchmarked
- SWE-bench VerifiedNot benchmarked
- Terminal-BenchNot benchmarked
- CodingNot benchmarked
- Instruction followingNot benchmarked
- Hard promptsNot benchmarked
Percentiles are the model's standing within each board's own population. Axes marked "not benchmarked" have no published result for this model — that is an absence of data, not a low score.
grok-3 stands at 49 (raw mean 48.6) — measured on 7 of 27 axes.
grok-3 scores at percentile 11.2 on ARC-AGI-2.
grok-3 ranks between #387 and #451 across 2 built-in weightings — best under "Reasoning", worst under "All sources".
Every claim is a computed fact from the current board data, phrased by a low-temperature model call and rejected by a validation gate if any number is not in the source row. How the leaderboards work →