Hacker News new | ask | show | jobs
by dr_kiszonka 926 days ago
Possibly the easiest way would be to run them in a notebook on Amazon SageMaker.

https://aws.amazon.com/sagemaker/notebooks/

1 comments

So you just start a notebook and then what?
You then download a model you want, say, Llama 2. Install a Python package to interact with the model (possibly `pip install llama-cpp-python`) and have fun.