[anon373839]

This is a 30B parameter model with 3B active. It should run performantly on a Mac with > 48GB RAM at 8bit precision.

[ltononro]

Well that is like 3 USD/hour if you run it on a rented gpu