xAI · model passport
Grok 3 Beta
grok-3-beta- Best percentile
- 56.7LiveBench
- Composite standing
- 45.9shrunk · 4/27 axes
What the data says
Benchmarked on 4 of 27 tracked axes. Every figure below is the model's own published result on that board.
Uneven: 32.1 percentile points between its best and worst axis — 56.7 pct on LiveBench versus 24.6 pct on FrontierMath.
- LiveBench56.7 pct56.9%Verify →
- GPQA Diamond49.3 pct67.6%Verify →
- AIME (math)40.5 pct55.6%Verify →
- FrontierMath24.6 pct3.8%Verify →
- OverallNot benchmarked
- WebDev ArenaNot benchmarked
- Vision ArenaNot benchmarked
- Factuality ArenaNot benchmarked
- Search ArenaNot benchmarked
- Document ArenaNot benchmarked
- Agent ArenaNot benchmarked
- SimpleQA VerifiedNot benchmarked
- ARC-AGI-2Not benchmarked
- Humanity's Last ExamNot benchmarked
- SimpleBenchNot benchmarked
- BFCL v4 (function calling)Not benchmarked
- SWE-bench Verified (live board)Not benchmarked
- Terminal-Bench 4.0Not benchmarked
- MMLU-Pro (Artificial Analysis)Not benchmarked
- LiveCodeBench (Artificial Analysis)Not benchmarked
- IFBench (Artificial Analysis)Not benchmarked
- HHEM Hallucination (Vectara)Not benchmarked
- SWE-bench VerifiedNot benchmarked
- Terminal-BenchNot benchmarked
- CodingNot benchmarked
- Instruction followingNot benchmarked
- Hard promptsNot benchmarked
Percentiles are the model's standing within each board's own population. Axes marked "not benchmarked" have no published result for this model — that is an absence of data, not a low score.
grok-3-beta stands at 45.9 (raw mean 42.8) — measured on 4 of 27 axes.
grok-3-beta ranks between #228 and #548 across 3 built-in weightings — best under "All-rounder", worst under "All sources".
Every claim is a computed fact from the current board data, phrased by a low-temperature model call and rejected by a validation gate if any number is not in the source row. How the leaderboards work →