[swirepe]

(They are definitely going to exceed their storage quotas.)

I want to see how well weights for these models compress, but it will take me some time to run this code and generate some. I'm guessing they won't compress well, but I can't articulate a reason why.

[wisty]

If weights compress, they have low information, which would suggest they're either useless or the architecture is bad.