Ibm · model passport
Granite 3.3 8B (Non-reasoning)
granite-3-3-8b- Best percentile
- 15.3LiveCodeBench (Artificial Analysis)
- Composite standing
- 31.0shrunk · 3/27 axes
What the data says
Benchmarked on 3 of 27 tracked axes. Every figure below is the model's own published result on that board.
Weakest axes
- 5.9 pct — IFBench (Artificial Analysis) (22.4%)
- 14.6 pct — MMLU-Pro (Artificial Analysis) (46.8%)
Uneven: 9.4 percentile points between its best and worst axis — 15.3 pct on LiveCodeBench (Artificial Analysis) versus 5.9 pct on IFBench (Artificial Analysis).
- LiveCodeBench (Artificial Analysis)15.3 pct12.7%Verify →
- MMLU-Pro (Artificial Analysis)14.6 pct46.8%Verify →
- IFBench (Artificial Analysis)5.9 pct22.4%Verify →
- OverallNot benchmarked
- WebDev ArenaNot benchmarked
- Vision ArenaNot benchmarked
- Factuality ArenaNot benchmarked
- Search ArenaNot benchmarked
- Document ArenaNot benchmarked
- Agent ArenaNot benchmarked
- GPQA DiamondNot benchmarked
- AIME (math)Not benchmarked
- FrontierMathNot benchmarked
- SimpleQA VerifiedNot benchmarked
- ARC-AGI-2Not benchmarked
- Humanity's Last ExamNot benchmarked
- SimpleBenchNot benchmarked
- LiveBenchNot benchmarked
- BFCL v4 (function calling)Not benchmarked
- SWE-bench Verified (live board)Not benchmarked
- Terminal-Bench 4.0Not benchmarked
- HHEM Hallucination (Vectara)Not benchmarked
- SWE-bench VerifiedNot benchmarked
- Terminal-BenchNot benchmarked
- CodingNot benchmarked
- Instruction followingNot benchmarked
- Hard promptsNot benchmarked
Percentiles are the model's standing within each board's own population. Axes marked "not benchmarked" have no published result for this model — that is an absence of data, not a low score.
Granite 3.3 8B (Non-reasoning) stands at 31 (raw mean 11.9) — measured on 3 of 27 axes.
Every claim is a computed fact from the current board data, phrased by a low-temperature model call and rejected by a validation gate if any number is not in the source row. How the leaderboards work →