[kiproping]

From a cursory glance on huggingface, the files don't add up to 2+TB. Unless it adds up to that when you extract the multiple ~17GB files, if that's the case then that's some crazy compression.

[zozbot234]

If it's 4-bit native for the sparse parameters (which is the bulk of them) why would you expect it to add up to 2+TB?