Open-Weight Model Families · 2024

Qwen (Qwen/Qwen2/Qwen2.5)

Jinze Bai, An Yang, Junyang Lin, Jingren Zhou

A technical report on Alibaba's Qwen2.5 family, a set of open-weight models spanning many sizes trained on a much larger pretraining corpus, with strong multilingual, coding, math, and long-context performance.

Editorial record

Plain-language summary

Qwen2.5 scales up the pretraining data to roughly 18 trillion tokens and refines the post-training pipeline (supervised fine-tuning plus reinforcement learning from preferences) across a range of model sizes from small to large. It targets improvements in instruction following, structured output, mathematics, and coding, and supports long context windows and many languages. The base and instruction-tuned weights are downloadable, giving practitioners a broad menu of sizes to fit different hardware budgets; most sizes are released under a permissive license while some larger ones use a more restrictive one, so it is open-weight.

Knowledge graph

Relationships

Descendants

Source record

Provenance

Record ID
P-363
Record created
2026-07-13
Last reviewed
2026-07-14
Record version
2

Citation caveat: Citation metadata is approximate and marked unverified in the source dataset.