Hacker News new | ask | show | jobs
by john_alan 109 days ago
you can't run models that are bigger than 16GB, not comparable.
1 comments

sure you can. system ram is will be your limiter here.
it's too slow for usable inference though.
Slow and can’t run are different things, but I get your point.