Hacker News new | ask | show | jobs
by proverbialbunny 2383 days ago
Is it possible to run data through a DNN, making sure the output is the same as the input (or close for lossless data), then take an autoencoder variant, record the 'compressed' data, then on the other end have the other half of the DNN to decompress it?

I'm pretty ignorant on the topic, so I get that that may be off, but if so, why wouldn't that be a valid solution to compressing data?

3 comments

Sure, and you can add some correction bits to fix the lossy encoding of the autoencoder.

The problem is that you have to encode/send the DNN itself, otherwise your receiver won't know how to decode the data. If you are not smart, the added codelength of the DNN will likely blow away your savings. If you are smart, this leads to a whole formulation of machine learning called MDL:

https://en.wikipedia.org/wiki/Minimum_description_length

Autoencoders have lossy compression.
Indeed, but this is for lossless compression :)