Hacker News new | ask | show | jobs
by alkh 412 days ago
How much RAM was it taking during inference?
1 comments

15.4GB during inference according to Activity Monitor
Oh, nice, that's actually not bad at all. Thanks, will give it a try on my 36Gb Mac