Grok 3 Preview 02.24

What the data says

Benchmarked on 4 of 27 tracked axes. Every figure below is the model's own published result on that board.

Uneven: 6.5 percentile points between its best and worst axis — 67.9 pct on Instruction following versus 61.4 pct on Coding.

• Instruction following67.9 pct1,403Verify →
• Overall66.2 pct1,411Verify →
• Hard prompts64.6 pct1,426Verify →
• Coding61.4 pct1,442Verify →
• WebDev ArenaNot benchmarked
• Vision ArenaNot benchmarked
• Factuality ArenaNot benchmarked
• Search ArenaNot benchmarked
• Document ArenaNot benchmarked
• Agent ArenaNot benchmarked
• GPQA DiamondNot benchmarked
• AIME (math)Not benchmarked
• FrontierMathNot benchmarked
• SimpleQA VerifiedNot benchmarked
• ARC-AGI-2Not benchmarked
• Humanity's Last ExamNot benchmarked
• SimpleBenchNot benchmarked
• LiveBenchNot benchmarked
• BFCL v4 (function calling)Not benchmarked
• SWE-bench Verified (live board)Not benchmarked
• Terminal-Bench 4.0Not benchmarked
• MMLU-Pro (Artificial Analysis)Not benchmarked
• LiveCodeBench (Artificial Analysis)Not benchmarked
• IFBench (Artificial Analysis)Not benchmarked
• HHEM Hallucination (Vectara)Not benchmarked
• SWE-bench VerifiedNot benchmarked
• Terminal-BenchNot benchmarked

Percentiles are the model's standing within each board's own population. Axes marked "not benchmarked" have no published result for this model — that is an absence of data, not a low score.