Hacker News new | ask | show | jobs
by lostmsu 726 days ago
70B parameters * 2 bytes each (fp16 or bf16) = 140GB

I wish models sizes were published in bytes.

1 comments

Thanks, I finished downloading it (which took many hours) onto an external hard drive (by adding a HF_HOME environmental variable for where to store that cache). Its size was 262 GB.