Zai · model passport
Cogvlm2 Llama3 Chat 19b
cogvlm2-llama3-chat-19b- Open weights
- CogVLM2 licence
- 19.5B params
- Released 2024-05-20(curated)
- Best percentile
- 3.3Vision Arena
- Cohort standing
- 38.3median 34.5
Thin coverage — read with caution
This model appears on only 1 of 27 benchmark axes considered. The overall standing has been shrunk toward the neutral 50 to reflect the small sample, and no weaknesses have been claimed — a low percentile on 2 axes is a coverage artifact, not a measured weakness.
What the data says
Benchmarked on 1 of 27 tracked axes. Every figure below is the model's own published result on that board.
On only 1 board(s), a ranked list of strengths would be false authority — the per-axis figures are shown below instead, without a verdict.
- Vision Arena3.3 pct963Verify →
- OverallNot benchmarked
- WebDev ArenaNot benchmarked
- Factuality ArenaNot benchmarked
- Search ArenaNot benchmarked
- Document ArenaNot benchmarked
- Agent ArenaNot benchmarked
- GPQA DiamondNot benchmarked
- AIME (math)Not benchmarked
- FrontierMathNot benchmarked
- SimpleQA VerifiedNot benchmarked
- ARC-AGI-2Not benchmarked
- Humanity's Last ExamNot benchmarked
- SimpleBenchNot benchmarked
- LiveBenchNot benchmarked
- BFCL v4 (function calling)Not benchmarked
- SWE-bench Verified (live board)Not benchmarked
- Terminal-Bench 4.0Not benchmarked
- MMLU-Pro (Artificial Analysis)Not benchmarked
- LiveCodeBench (Artificial Analysis)Not benchmarked
- IFBench (Artificial Analysis)Not benchmarked
- HHEM Hallucination (Vectara)Not benchmarked
- SWE-bench VerifiedNot benchmarked
- Terminal-BenchNot benchmarked
- CodingNot benchmarked
- Instruction followingNot benchmarked
- Hard promptsNot benchmarked
Percentiles are the model's standing within each board's own population. Axes marked "not benchmarked" have no published result for this model — that is an absence of data, not a low score.
How to run it
Run it yourself
Transformers
from transformers import AutoModelForCausalLM, AutoTokenizer
model_id = "zai-org/cogvlm2-llama3-chat-19B"
tokenizer = AutoTokenizer.from_pretrained(model_id)
model = AutoModelForCausalLM.from_pretrained(model_id)Ollama
We don't sync Ollama tags, so we won't print a command we can't verify — a wrong one would pull the wrong model. Search the Ollama library →
Unsloth fine-tuning recipes are model-specific and we don't derive them here. Unsloth docs →
Identifiers, limits and prices are synced from the upstream source shown above. Any field we haven't synced is left out entirely rather than guessed.
cogvlm2-llama3-chat-19b stands at 38.3 (raw mean 3.3) — measured on only 1 of 27 axes, so the standing is shrunk toward the neutral 50.
cogvlm2-llama3-chat-19b stands at 38.3 versus a cohort median of 34.5 across 120 models released within 180 days — above the peer median.
Every claim is a computed fact from the current board data, phrased by a low-temperature model call and rejected by a validation gate if any number is not in the source row. How the leaderboards work →