Hacker News new | ask | show | jobs
by jfoucher 1032 days ago
I'm a complete beginner regarding this stuff, so if I may ask, how would I go about downloading the relevant model (e.g. wizardcoder-python-34b-v1.0.Q4_K_S.gguf) I checked on Hugging face but all I got was a bunch of .bin files...

Thanks.

2 comments

Do a search on the HuggingFace models page, e.g.:

https://huggingface.co/models?sort=trending&search=wizardcod...

Thanks, I managed to convert what I had downloaded with the convert.py script in llama.cpp.
Google the filename + "torrent download"