Hacker News new | ask | show | jobs
by song 64 days ago
So, on a mac, what good alternative to ollama supports mlx for acceleration? My main use case is that I have an old m1 max macbook pro with 64 gb ram that I use as a model server.
2 comments
wrxd 64 days ago
I read good things about https://omlx.ai but I don't really know enough of the ecosystem to know if there are better options.

If someone has opinions please let us know!

link
Zetaphor 63 days ago
LM Studio is a popular option that bundles the MLX backend
link