[xvector]

Some other local LLM iOS apps:

- MLC Chat: https://llm.mlc.ai

- LLM Farm: https://llmfarm.site

- Enchanted (not local, just a frontend): https://github.com/AugustDev/enchanted

But I don't think any of these support Mistral 0.2 which is a pretty big deal.

[stoorafa]

MLC Chat supports Mistral 0.2 (7B, q3f16_1, it seems)

[swyx]

where can i find info about Mistral 0.2? why is it harder to support than Mistral 0.1?

[xvector]

It's just newer