Hacker News new | ask | show | jobs
by iAkashPaul 784 days ago
You can either modify the Android example inside llama.cpp or my fork of it at GitHub.com/iakashpaul/portal

Increase the Ctx to more than 100 & link to any Q4 GGUF of 7B