Animation · 8 steps
The whole way from text to the next token. Use “Next” to go step by step, “Play” runs on its own.

text“Die Hauptstadtvon Frankreich ist”7 tokenswith their IDs7 embeddings of1,024 numberstext + “Paris”next roundblocks mixin contextsoftmax + selection“Paris” 47.5%output head151,936 scoreslast stateat “ist” 12345678