Hacker News new | ask | show | jobs
by brucethemoose2 991 days ago
OK I am hosting the instruct model on the horde now. I will throw up the raw base model too:

https://lite.koboldai.net/#

Note that you must switch to instruct mode in the UI, and use the "LLama 2 chat" preset, but you also need a <s> token in the instruction (memory) tab:

https://huggingface.co/mistralai/Mistral-7B-Instruct-v0.1#in...