[hmottestad]

LM Studio is a great way to test out LLMs on my MacBook: https://lmstudio.ai/

Really easy to search huggingface for new models to test directly in the app.

[LeoPanthera]

Make sure you get the prompt template set correctly, the defaults are wrong for a lot of models.

[unifer1]

Could you explain how to do this properly ? I've been having problems with the app and am wondering if this is ehy

[LeoPanthera]

Look at the HuggingFace page for the model you are using. (The original page, not the page for the GGUF conversion, if necessary.) This will explain the chat format you need to use.