[f0000]

Just run them on AWS

[pogue]

Can you expand more on how that's done or point me in the direction to a guide?

[dr_kiszonka]

Possibly the easiest way would be to run them in a notebook on Amazon SageMaker.

https://aws.amazon.com/sagemaker/notebooks/

[dvfjsdhgfv]

So you just start a notebook and then what?

[dr_kiszonka]

You then download a model you want, say, Llama 2. Install a Python package to interact with the model (possibly `pip install llama-cpp-python`) and have fun.

[PeterStuer]

How would AWS run the user's models locally (as per the question)?