Hacker News new | ask | show | jobs
by Raf_ 2291 days ago
Thanks so much - glad to hear the Jim part, especially since it drove me nuts when I started generating text.

I wrote a paragraph for the FAQ on the over-fitting on Jim's dad monologues - not sure if it's true, but I think it's fun to ponder:

> For some reason the model picked on the monologues of Jim's (James Incandenza’s) dad. I found it funny that many sentences in some of the rambling monologues that the model is spewing end with ", Jim.". It's been a while since I last read the book, but I don't think these parts comprised more than, say, 5% of the book. It's interesting that the model fixated on them so much. My pet theory is that the model sees a rambling semi-coherent monologue it's producing, and then looks back at it and thinks "Oh, I must be inside one of these dumb Jim's dad monologues"