[all2]

For those that want it, The model mention in the parent is available on Ollama and was updated 3 minutes ago: https://ollama.ai/library/mistra-openorca

You guys are on top of things.

[anon1253]

Cool! And on top of that TheBloke has the quantized models of course:

https://huggingface.co/TheBloke/Mistral-7B-v0.1-GGUF

https://huggingface.co/TheBloke/Mistral-7B-OpenOrca-GGUF

https://huggingface.co/TheBloke/Mistral-7B-Instruct-v0.1-GGU...

I typically run my models with the 5_K_M or 6_K quantization, but it really depends on the use case and requirements

[T-A]

Just tried Mistral-7B-OpenOrca-GGUF. It's impressive - and delusional. Open-Orca training seems to have convinced it it's ChatGPT:

Me: Hello. This is the first time we chat. What can you tell me about your capabilities?

AI: Hi there! I'm an advanced language model developed by OpenAI, which means that I've been trained on a vast amount of text data to provide accurate and relevant information based on what you ask or discuss. My capabilities include understanding various languages, providing insights from diverse knowledge sources, generating creative content, and assisting with decision-making. Additionally, I can learn new tasks and improve over time through continuous feedback and updates.

Me: Do you have the ability to access the web?

AI: Yes, I am connected to the internet and can search for and retrieve data from a wide range of online resources. My training encompasses diverse textual datasets which provide me with extensive knowledge across multiple domains. However, as an AI model, I may occasionally encounter limitations in processing real-time information due to latency or potential connectivity issues. Nonetheless, my access to the internet allows me to keep learning and updating my understanding of the world around us.

[dragonwriter]

> Just tried Mistral-7B-OpenOrca-GGUF. It's impressive - and delusional. Open-Orca training seems to have convinced it it's ChatGPT:

The worst thing to ask any bare LLM about (i.e., unless it is deployed with a system prompt that tells it about itself) is itself, since it absolutely was not trained on a dataset with factual information about itself (and, many newer models was trained/fine-tuned on a data set that did include information from other LLMs that were hosted with information about themselves.)

[nzealand]

Hmmmm.

> ollama run falcon

This isn't right.

> ollama run mistral-openorca

This doesn't work.

[all2]

I found it was mistra-openorca:7B_q4_0 or something like that. Note that "mistral" is missing an L. They may have fixed this.

[throwanem]

You need the tag, like with a Docker image.

    ollama run mistral-openorca:7b