[lowyek]

Hi simon, is there a way to run the vision model easily on my mac locally?

[simonw]

Not that I’ve seen so far, but Ollama are pending a solution for that “soon”.

[v3ss0n]

I doubt ollama team can do much about it. Ollama are just wrapper on top of heavy lifter

[Patrick_Devine]

The draft PRs are already up in the repo.

[theaniketmaurya]

You can run it with LitServe (MPS GPU), here is the code - https://lightning.ai/lightning-ai/studios/deploy-llama-3-2-v...