Animation · 5 steps
One pass for the word “bank” in the sentence “I sit on the bank in the park”, with made-up numbers. Each vector has two places: (place to sit | money). Use “Next” to go step by step.

Queryof “bank”(1 | 0)Keyssit (2 | 0)on (1 | 0) …Valuessit (2 | 0)bank (1 | 1) …Scoressit 2on 1 …Sharessit 50%on 18% …Mix(1.2 | 0.2)old stateof “bank”(1 | 1)new stateof “bank”(2.2 | 1.2) comparecompareSoftmaxtimes sharepass on++