Hacker News new | ask | show | jobs
by carefulobserver 1022 days ago
can you run large language models out of orbstack? I imagine it's not possible but am curious
1 comments
kdrag0n 1022 days ago
Technically yes, but CPU only. In theory it might be possible to support ANE/MPS, but it wouldn't be useful in practice because Linux software isn't built to use them, and there wouldn't be a good way to expose them.
link