Hacker News new | ask | show | jobs
by seydor 1118 days ago
does this only work with llamaCPP ? I.e. can't use GPU models with this?
1 comments
joebiden2 1118 days ago
llama supports GPU by now: https://old.reddit.com/r/LocalLLaMA/comments/13gok03/llamacp...
link
seydor 1118 days ago
How do i enable GPU in privateGPT w llamaCpp ? It turns my CPU to a vacuum cleaner
link