Hacker News new | ask | show | jobs
by atwrk 148 days ago
To add a few more details: llama.ccp now both has a web ui out of the box that even supports model switching, and easy model file downloads from huggingface using the cli: '-hf name_of_model:the_quant_you_want'.