|
|
|
|
|
|
by dkjaudyeqooe
919 days ago
|
|
|
Roughly speaking I believe it's the number of parameters times the size of the parameters. So in the 4 bit case it's half a gigabyte per billion parameters. From a performance point of view (quantized) integer parameters are going to run better on CPUs than floating point parameters. |
|
|