Hacker News new | ask | show | jobs
by Der_Einzige 1700 days ago
Re: "Glorified Hastable"

There is a 1-1 correspondence between data compression and generative models. GPT-2 is a highly effective loseless data compression tool: https://bellard.org/textsynth/sms.html

Always wondered why this insight is not taught as much, especially in the context of things like dimensionality reduction...

1 comments

The Hutter prize for improved compression algorithms is explicitly about the relationship between compression and intelligence. http://prize.hutter1.net/