Claim record · edition 1.0.0
Provider technical reports and model cards are self-reports by the organization that built the system, and may withhold architecture, data, and training details.
The GPT-4 technical report states that it withholds such details; model cards are a reporting convention, not an audit mechanism.
Limits of this claim
Self-report status is not an accusation of inaccuracy. It means the figures were not produced by an independent party and cannot be treated as independent measurements.
Supporting source records · 3
GPT-4 Technical Report
OpenAI · 2023
Cited as an example of a provider technical report, including its own disclosure that architecture and training details are withheld. Not an independent measurement.
Source record →Model Cards for Model Reporting
Mitchell et al. · 2019
The reporting convention whose existence is why provider self-reports are structured the way they are.
Source record →The Llama 3 Herd of Models
Grattafiori et al. (Meta) · 2024
A comparatively detailed provider training report; still a self-report.
Source record →