Open-Weight Model Families · 2024
Qwen (Qwen/Qwen2/Qwen2.5)
A technical report on Alibaba's Qwen2.5 family, a set of open-weight models spanning many sizes trained on a much larger pretraining corpus, with strong multilingual, coding, math, and long-context performance.
Editorial record
Plain-language summary
Qwen2.5 scales up the pretraining data to roughly 18 trillion tokens and refines the post-training pipeline (supervised fine-tuning plus reinforcement learning from preferences) across a range of model sizes from small to large. It targets improvements in instruction following, structured output, mathematics, and coding, and supports long context windows and many languages. The base and instruction-tuned weights are downloadable, giving practitioners a broad menu of sizes to fit different hardware budgets; most sizes are released under a permissive license while some larger ones use a more restrictive one, so it is open-weight.
Knowledge graph
Relationships
Descendants
ExtendsEvidence: Strongly supported
LLaMA: Open and Efficient Foundation Language Models
Qwen builds on the open paradigm
P-363
Parallel developmentEvidence: Probable
GLM: General Language Model Pretraining with Autoregressive Blank Infilling / GLM-130B
GLM and Qwen are parallel open-weight bilingual model families
model families
Source record
Provenance
- Record ID
- P-363
- Record created
- 2026-07-13
- Last reviewed
- 2026-07-14
- Record version
- 2
- https://arxiv.org/abs/2412.15115
- arXiv:2412.15115
Citation caveat: Citation metadata is approximate and marked unverified in the source dataset.