Hacker News new | ask | show | jobs
How much do language models memorize? (arxiv.org)
58 points by mhmmmmmm 387 days ago
1 comments

I enjoyed reading this paper. The experiments are well-designed and it's well-written.

Much work on generalization of ML models deals with asymptotic bounds. Here, there's a precise way of measuring these, even for relatively large models with millions of parameters.