Open-Weight Model Families · 2022
BLOOM: A 176B-Parameter Open-Access Multilingual Language Model
Produced a 176-billion-parameter multilingual language model through an open 1000-researcher collaboration, releasing the weights, training code, and data so a frontier-scale model was no longer the preserve of a single well-resourced lab.
Editorial record
Plain-language summary
BLOOM was trained by the BigScience workshop on the ROOTS corpus spanning 46 natural and 13 programming languages, with the model, code, and data documentation released openly under a responsible-AI licence. It brought many languages underserved by English-centric models into a large open model and made the full training process transparent. It was an early proof that open, multi-institution collaboration could build models at frontier scale.
Knowledge graph
Relationships
Descendants
Depends onEvidence: Strongly supported
Attention Is All You Need
BLOOM is a decoder-only Transformer
BLOOM 2211.05100
Parallel developmentEvidence: Strongly supported
LLaMA: Open and Efficient Foundation Language Models
BLOOM and LLaMA are parallel large open language models
open ecosystem
Source record
Provenance
- Record ID
- P-368
- Record created
- 2026-07-13
- Last reviewed
- 2026-07-14
- Record version
- 2
- https://arxiv.org/abs/2211.05100
- arXiv:2211.05100
Citation caveat: Citation metadata is approximate and marked unverified in the source dataset.