Hacker News new | ask | show | jobs
by hammock 729 days ago
Thanks. Forgive me I'm not a coder, what's the easiest way to use/run this?
4 comments

Easiest way to test the one referenced on the post (neuraldaredevil-8b-abliterat-psq) is to simply deploy to HF Endpoints: https://ui.endpoints.huggingface.co/new?repository=mlabonne/...
If you've got a Google account you can run it on Colab (probably need to copy it to your account first)
Download ollama and import the model listed at the end of the article.
this is a jupyter notebook. so you'll need to download that.