[oblio]

Can you run any of those models without $20 000 worth of hardware that uses as much power and makes as much noise as a small factory?

[segmondy]

I run them with under $3,000 hardware and inference is about 500-600watts with no noise.