Hacker News new | ask | show | jobs
by alduin32 1169 days ago
Well, only if you don't count the filesystem cache as "RAM". You still need enough memory so that the kernel can hold all these pages, even if Llama.cpp is not using this memory itself.