Animation · 5 steps
This is how a model fetches the numbers for each token. Use “Next” to go step by step, “Play” runs on its own.

token IDs417 · 82 · 903 · 771 · 13table in the model50,257 × 768sentence matrix 5 × 768rows 417 · 82 · 903 · 771 · 13row 417768 learned numbers row numberread rowstack