Model passport
Falcon 180b Chat
falcon-180b-chat- Open weights
- Falcon-180B TII License licence
- Released 2023-09-06(curated)
- Overall · LMArena
- 1,148#359 of 396
- Best percentile
- 11.4Instruction following
- Cohort standing
- 29.6median 26.2
What the data says
Benchmarked on 3 of 27 tracked axes. Every figure below is the model's own published result on that board.
Weakest axes
- 6.6 pct — Hard prompts (1,128)
- 9.6 pct — Overall (1,148)
- 11.4 pct — Instruction following (1,135)
Uneven: 4.8 percentile points between its best and worst axis — 11.4 pct on Instruction following versus 6.6 pct on Hard prompts.
- Instruction following11.4 pct1,135Verify →
- Overall9.6 pct1,148Verify →
- Hard prompts6.6 pct1,128Verify →
- WebDev ArenaNot benchmarked
- Vision ArenaNot benchmarked
- Factuality ArenaNot benchmarked
- Search ArenaNot benchmarked
- Document ArenaNot benchmarked
- Agent ArenaNot benchmarked
- GPQA DiamondNot benchmarked
- AIME (math)Not benchmarked
- FrontierMathNot benchmarked
- SimpleQA VerifiedNot benchmarked
- ARC-AGI-2Not benchmarked
- Humanity's Last ExamNot benchmarked
- SimpleBenchNot benchmarked
- LiveBenchNot benchmarked
- BFCL v4 (function calling)Not benchmarked
- SWE-bench Verified (live board)Not benchmarked
- Terminal-Bench 4.0Not benchmarked
- MMLU-Pro (Artificial Analysis)Not benchmarked
- LiveCodeBench (Artificial Analysis)Not benchmarked
- IFBench (Artificial Analysis)Not benchmarked
- HHEM Hallucination (Vectara)Not benchmarked
- SWE-bench VerifiedNot benchmarked
- Terminal-BenchNot benchmarked
- CodingNot benchmarked
Percentiles are the model's standing within each board's own population. Axes marked "not benchmarked" have no published result for this model — that is an absence of data, not a low score.
falcon-180b-chat stands at 29.6 (raw mean 9.2) — measured on 3 of 27 axes.
falcon-180b-chat stands at 29.6 versus a cohort median of 26.2 across 65 models released within 180 days — above the peer median.
falcon-180b-chat scores at percentile 6.6 on Hard prompts.
falcon-180b-chat scores at percentile 9.6 on Overall.
falcon-180b-chat ranks between #371 and #785 across 4 built-in weightings — best under "Conversation-first", worst under "All sources".
Every claim is a computed fact from the current board data, phrased by a low-temperature model call and rejected by a validation gate if any number is not in the source row. How the leaderboards work →