Hacker News new | ask | show | jobs
by GaggiX 649 days ago
The weight size depends on the accuracy you are running the model at, you usually do not run a model at fp16 as it would be wasteful.