Hacker News new | ask | show | jobs
by simion314 1179 days ago
Do you know what is the way to find models compatible with oobabooga/text-generation-webui ? I downloaded one with the included script and that worked, but if I try different ones it seems there are so many formats so no idea say how do I search huggingface or google to find the correct format. I would like to try this new quantized LLAMA versions with the GUI, I can run them in the CLI on the CPU but llama.cpp uses ggml formats .
1 comments

https://rentry.org/nur779 (scroll down to the Huggingface ones)