Source record · content verified
The Llama 3 Herd of Models
provider self report2024
Why this source is here
A comparatively detailed provider training report; still a self-report.
- Verification
- Content-verified on 2026-07-27: the canonical source and its title were resolved during the Atlas review. This is not an endorsement of the source’s argument.
- Authors
- Grattafiori et al. (Meta)
- Identifier
- arXiv:2407.21783
Claims citing this source · 2
- si-004
The compute-optimal allocation between parameters and training tokens has been revised in the literature, and deployed practice diverges from compute-optimal training.
- si-020
Provider technical reports and model cards are self-reports by the organization that built the system, and may withhold architecture, data, and training details.