[jampekka]

Current LLMs are equivalent to tabular Markov chains (though these are too huge to realistically compute). What's the size limit when a tabular Markov chain can generalize to novel inputs?

[IshKebab]

No idea. I'm not sure how that's relevant anyway.