[john_alan]

you can't run models that are bigger than 16GB, not comparable.

[nickthegreek]

sure you can. system ram is will be your limiter here.

[john_alan]

it's too slow for usable inference though.

[nickthegreek]

Slow and can’t run are different things, but I get your point.