[reustle]

You can definitely start by checking out ollama, it was super helpful for me

[marcopicentini]

It’s only for MacOSX. I expect to load the model on a Ubuntu server, not on my local dev machine.

[Menatombo]

You have to build it if you want it for Ubuntu, Windows, or anything else. Just build Go on your machine and have at it.