Hacker News new | ask | show | jobs
by BrunoJo 967 days ago
We are using Mistral at https://lemonfox.ai/. With Lemonfox you can easily switch from the OpenAI API to open source AI models. Mistral has been working well as a gpt-3.5 replacement but we are currently planning to switch to Zephyr - a fine-tuned Mistral model. We've seen some nice improvements with Zephyr especially with non-English prompts/responses.
1 comments

Are y'all doing anything in particular to stretch the context out? Just plain old rope scaling?

While it seems to be a base model, I'm pretty excited about coming finetunes on this one: https://huggingface.co/SciPhi/SciPhi-Mistral-7B-32k