Hacker News new | ask | show | jobs
by kpennell 991 days ago
sorry for the dumb question. Is there somewhere I can try it? Like a chatbot?
1 comments
brucethemoose2 991 days ago
Huggingface Spaces. Be sure to get the prompting syntax right: https://huggingface.co/mistralai/Mistral-7B-Instruct-v0.1

I will try to host an instance on the AI Horde later today, which has a better UI and doesn't need a login.

link
brucethemoose2 991 days ago
OK I am hosting the instruct model on the horde now. I will throw up the raw base model too:

https://lite.koboldai.net/#

Note that you must switch to instruct mode in the UI, and use the "LLama 2 chat" preset, but you also need a <s> token in the instruction (memory) tab:

https://huggingface.co/mistralai/Mistral-7B-Instruct-v0.1#in...

link