Hacker News new | ask | show | jobs
by ghthor 845 days ago
NixOS just got tabbyml[1] which is built on llama-cpp. Working on systemsd services the weekend and updating latest tabbyml release which supports rocm in addition to cuda

[1] https://github.com/TabbyML/tabby

[2] https://github.com/NixOS/nixpkgs/pull/291744
1 comments
ghthor 845 days ago
Systemd service PR posted to nixpkgs

https://github.com/NixOS/nixpkgs/pull/292873

link