#attention-mechanism

1 story

#embedding #gpt2 #llm #mlp #neural-network #positional-encoding #probability-distribution #self-attention #temperature-parameter #text-generation #transformer

Transformer Explainer: LLM Model Visualized
See how GPT-2 (small) predicts text with self-attention and MLP layers.
Github · 1m