#positional-encoding

1 story

#attention-mechanism #embedding #gpt2 #llm #mlp #neural-network #probability-distribution #self-attention #temperature-parameter #text-generation #transformer

Transformer Explainer: LLM Model Visualized
See how GPT-2 (small) predicts text with self-attention and MLP layers.
Github · 1m