|
|
|
|
|
by pessimizer
612 days ago
|
|
People have their favorite phrases or words, but also as readers we fixate on words that we don't personally use, and project that onto the writer. But as a second language learner, you notice that people get stuck on particular words during writing sessions. If I run into a very unusual (and unnecessary) word, I know they're going to use it again within a page or two, maybe once after that, then never again. I blame it on the writer remembering a cool word, or finding a cool word in a thesaurus, then that word dropping out of their active vocabulary after they tried it out a couple times. There's probably an analogue in LLMs, if just because that makes unusual words more likely to repeat themselves in a particular passage. |
|
I think words I've used recently are easier to access, as if there's a cache for items recently retrieved from deeper layers of memory.