Hacker News new | ask | show | jobs
by Myrmornis 15 days ago
Sure but the question is why "load" after X?
2 comments

Because, for some high number of contexts, its likelihood comes out high in the big tree of multiplies that is claude's model. For some sets of 500 words (or whatever), the next word is "load". The classifier that decides which sets of 500 (or whatever) words is a prefix for "load" is returning "true" too often.
More-or-less the same principle, but scaled up massively, and with context-dependent probability conditioning maps.