Hacker News new | ask | show | jobs
by wfhpw 913 days ago
Yes but loading weights into memory takes time
1 comments
TotalCrackpot 913 days ago
Yeah I imagine sequential inference would be slower. How long do you have to wait to load these weights on a personal PC? I have not tried using those systems so far.
link