Hacker News new | ask | show | jobs
by yjftsjthsd-h 846 days ago
NixOS has packages for llama-cpp and ollama: https://search.nixos.org/packages?channel=23.11&from=0&size=...

Edit: And Arch packages ollama officially - https://archlinux.org/packages/?sort=&q=llama&maintainer=&fl... - and a few things in the AUR - https://aur.archlinux.org/packages?O=0&K=llama
1 comments
ghthor 845 days ago
NixOS just got tabbyml[1] which is built on llama-cpp. Working on systemsd services the weekend and updating latest tabbyml release which supports rocm in addition to cuda

[1] https://github.com/TabbyML/tabby

[2] https://github.com/NixOS/nixpkgs/pull/291744

link
ghthor 845 days ago
Systemd service PR posted to nixpkgs

https://github.com/NixOS/nixpkgs/pull/292873

link