[thot_experiment]

Are you running vision tasks? Works just fine in ollama as an LLM but the vision component is unimplemented.

[pitzips]

I'm using gemma3:27b with the latest ollama (0.6.2) and vision is working.

[thot_experiment]

Yes but we're talking about mistral 3.1 here, which doesn't have the vision component implemented, looks like vllm supports it though.

[simonw]

Mistral 3.1 vision works with MLX and mlx-vlm - https://github.com/Blaizzy/mlx-vlm/pull/256

https://huggingface.co/mlx-community/Mistral-Small-3.1-24B-I...