Hacker News new | ask | show | jobs
by msoad 736 days ago
https://colab.research.google.com/drive/1VYm3hOcvCpbGiqKZb14...
1 comments

Thanks. Forgive me I'm not a coder, what's the easiest way to use/run this?
Easiest way to test the one referenced on the post (neuraldaredevil-8b-abliterat-psq) is to simply deploy to HF Endpoints: https://ui.endpoints.huggingface.co/new?repository=mlabonne/...
If you've got a Google account you can run it on Colab (probably need to copy it to your account first)
Download ollama and import the model listed at the end of the article.
this is a jupyter notebook. so you'll need to download that.