Google · model passport
Gemini 1 5 Pro 001
gemini-1-5-pro-001- Cloud only
- Proprietary licence
- Released 2024-04-09(curated)
- Overall · LMArena
- 1,324#234 of 396
- Best percentile
- 41.2Overall
- Cohort standing
- 36.9median 32.8
What the data says
Benchmarked on 8 of 27 tracked axes. Every figure below is the model's own published result on that board.
Uneven: 21.2 percentile points between its best and worst axis — 41.2 pct on Overall versus 20 pct on AIME (math).
- Overall41.2 pct1,324Verify →
- Instruction following41.2 pct1,312Verify →
- Hard prompts39.9 pct1,327Verify →
- Coding35 pct1,346Verify →
- LiveBench27.8 pct40.3%Verify →
- GPQA Diamond27.1 pct45.9%Verify →
- Vision Arena23.3 pct1,120Verify →
- AIME (math)20 pct6.8%Verify →
- WebDev ArenaNot benchmarked
- Factuality ArenaNot benchmarked
- Search ArenaNot benchmarked
- Document ArenaNot benchmarked
- Agent ArenaNot benchmarked
- FrontierMathNot benchmarked
- SimpleQA VerifiedNot benchmarked
- ARC-AGI-2Not benchmarked
- Humanity's Last ExamNot benchmarked
- SimpleBenchNot benchmarked
- BFCL v4 (function calling)Not benchmarked
- SWE-bench Verified (live board)Not benchmarked
- Terminal-Bench 4.0Not benchmarked
- MMLU-Pro (Artificial Analysis)Not benchmarked
- LiveCodeBench (Artificial Analysis)Not benchmarked
- IFBench (Artificial Analysis)Not benchmarked
- HHEM Hallucination (Vectara)Not benchmarked
- SWE-bench VerifiedNot benchmarked
- Terminal-BenchNot benchmarked
Percentiles are the model's standing within each board's own population. Axes marked "not benchmarked" have no published result for this model — that is an absence of data, not a low score.
gemini-1.5-pro-001 stands at 36.9 (raw mean 31.9) — measured on 8 of 27 axes.
gemini-1.5-pro-001 stands at 36.9 versus a cohort median of 32.8 across 117 models released within 180 days — above the peer median.
On OTIS Mock AIME, gemini-1.5-pro-001 raised the running best score by 2.1 percentage points to 6.8% on 2024-04-09.
gemini-1.5-pro-001 ranks between #225 and #930 across 5 built-in weightings — best under "Conversation-first", worst under "All sources".
Every claim is a computed fact from the current board data, phrased by a low-temperature model call and rejected by a validation gate if any number is not in the source row. How the leaderboards work →