Hacker News new | ask | show | jobs
by joaogui1 1044 days ago
That looks interesting, do you know what paper talks about the connection between MDL, regret, and weight decay?
1 comments
tbalsam 1044 days ago
I would start with Shannon's information theory and the Wikipedia page on L2/the MDL as a decent starting point.

For the first, there are a few good papers that simplify the concepts even further.

link
joaogui1 1039 days ago
Sorry, I know what MDL and L2 regularization are, I would like the paper that connects them in the way you mentioned
link