[hiAndrewQuinn]

I don't see that as a problem. You can get much stronger compression if you allow it to be lossy. This naturally flows out of information value decreasing exponentially.