GLOSSARY · AI SECURITY
Transformer
The transformer is the neural network architecture, introduced by Google researchers in the 2017 paper 'Attention Is All You Need', that underlies virtually all modern large language models.
Its attention mechanism lets the model weigh relationships between all parts of an input at once, which made training on massive datasets practical. The T in GPT stands for transformer.