[antixk]

Becuase unless you have a certain (high) level of sparsity, sparse formats are infact ineffective in storing. There are cases where sparse formats take more memory than storing dense tensors.

[posharma]

Sure. It’s still one of the methods to compress models. You might be surprised how often the weights are really quite sparse.