Hacker News new | ask | show | jobs
by LeoPanthera 806 days ago
Make sure you get the prompt template set correctly, the defaults are wrong for a lot of models.
1 comments
unifer1 806 days ago
Could you explain how to do this properly ? I've been having problems with the app and am wondering if this is ehy
link
LeoPanthera 806 days ago
Look at the HuggingFace page for the model you are using. (The original page, not the page for the GGUF conversion, if necessary.) This will explain the chat format you need to use.
link