[jalammar]

Author here. Thank you. I feel an important element of this type of writing is what complexity to show and what to hide at different points. "Magic" is just to say "don't worry about the contents of this box yet, we'll get to it". It's what we discuss right after the visual. Sorry that came out as confusing. I'll add a note to the following figure saying that's the magic.

[randomnumber314]

I get the sense that you're trying to mask the simplicity of predicting the next-most-likely-word after training your app, ala markov chains, under the guise of "magical AI." Providing an error threshold when it spits out the wrong response to a phrase seems to be worsening its natural ability as well.