Claim record · edition 1.0.0
si-001Established result
The transformer architecture replaces recurrence and convolution with attention as the primary sequence-modelling mechanism.
This is an architectural fact stated by the originating paper and universally adopted since.
Limits of this claim
Architecture alone determines no capability. Nothing about attention implies any particular task competence.
Supporting source records · 1
primary paperContent verified
Attention Is All You Need
Vaswani et al. · 2017
The architecture paper underlying the transformer models this atlas is about.
Source record →