Hacker News new | ask | show | jobs
by otabdeveloper4 1 day ago
> on-premise GPU cluster

Renting a GPU server from a cloud and hosting your own llama.cpp is the path of least resistance.