Hacker News new | ask | show | jobs
by xiphias2 1194 days ago
> For 7B model, it always goes above 32gb of RAM,

That's double of what Tinygrad uses
1 comments
DennisAleynikov 1193 days ago
Tinygrad is using openCL right?
link