Visualization of How GPT Works Using a Simplified GPT2 Model

Cool visualization of how GPT works (using a simplified GPT2 model).

You can enter a phrase and see how the model predicts the next word (key) layer by layer. You also have the option to change settings and see how they affect the predictions.

https://poloclub.github.io/transformer-explainer/