#self-attention

1 story

#attention-mechanism #embedding #gpt2 #llm #mlp #neural-network #positional-encoding #probability-distribution #temperature-parameter #text-generation #transformer

Transformer Explainer: LLM Model Visualized
See how GPT-2 (small) predicts text with self-attention and MLP layers.
Github · 1m