Mistral · model passport
Mistral Large 2411
mistral-large-2411- Open weights
- MRL licence
- Released 2024-11-01(from model name)
- Overall · LMArena
- 1,306#260 of 396
- Best percentile
- 93.3HHEM Hallucination (Vectara)
- Cohort standing
- 42.3median 40.2
What the data says
Benchmarked on 10 of 27 tracked axes. Every figure below is the model's own published result on that board.
Strongest axes
- 93.3 pct — HHEM Hallucination (Vectara) (95.5%)
Weakest axes
- 7.2 pct — FrontierMath (0.3%)
Uneven: 86.1 percentile points between its best and worst axis — 93.3 pct on HHEM Hallucination (Vectara) versus 7.2 pct on FrontierMath.
- HHEM Hallucination (Vectara)93.3 pct95.5%Verify →
- BFCL v4 (function calling)Dormant board58.5 pct38.4%Verify →
- LiveBench40.2 pct48.4%Verify →
- Instruction following37.4 pct1,295Verify →
- GPQA Diamond35.7 pct51.3%Verify →
- Hard prompts35.4 pct1,313Verify →
- Coding34.8 pct1,346Verify →
- Overall34.6 pct1,306Verify →
- AIME (math)22.5 pct7.8%Verify →
- FrontierMath7.2 pct0.3%Verify →
- WebDev ArenaNot benchmarked
- Vision ArenaNot benchmarked
- Factuality ArenaNot benchmarked
- Search ArenaNot benchmarked
- Document ArenaNot benchmarked
- Agent ArenaNot benchmarked
- SimpleQA VerifiedNot benchmarked
- ARC-AGI-2Not benchmarked
- Humanity's Last ExamNot benchmarked
- SimpleBenchNot benchmarked
- SWE-bench Verified (live board)Not benchmarked
- Terminal-Bench 4.0Not benchmarked
- MMLU-Pro (Artificial Analysis)Not benchmarked
- LiveCodeBench (Artificial Analysis)Not benchmarked
- IFBench (Artificial Analysis)Not benchmarked
- SWE-bench VerifiedNot benchmarked
- Terminal-BenchNot benchmarked
Percentiles are the model's standing within each board's own population. Axes marked "not benchmarked" have no published result for this model — that is an absence of data, not a low score.
mistral-large-2411 stands at 42.3 (raw mean 40) — measured on 10 of 27 axes.
mistral-large-2411 stands at 42.3 versus a cohort median of 40.2 across 139 models released within 180 days — above the peer median.
mistral-large-2411 scores at percentile 93.3 on HHEM Hallucination (Vectara).
mistral-large-2411 scores at percentile 7.2 on FrontierMath.
mistral-large-2411 shows a 86.1-point percentile gap across 10 covered axes: 93.3 on HHEM Hallucination (Vectara) versus 7.2 on FrontierMath.
mistral-large-2411 ranks between #239 and #606 across 5 built-in weightings — best under "Coding-focused", worst under "All sources".
Every claim is a computed fact from the current board data, phrased by a low-temperature model call and rejected by a validation gate if any number is not in the source row. How the leaderboards work →