Large Language Model (LLM) Input text ↓ lexical analysis List of tokens ↓ 1-hot encoding One long sparse vector per token ↓ encoder One short dense vector per token ↓ concatenation One long dense vector representing the entire input ↓ transformer One long dense vector representing the entire input with some contextual disambiguation ↓ ANN One short dense vector representing what token probably comes next ↓ decoder One word