Hacker News new | ask | show | jobs
by telotortium 421 days ago
Entirely due to the unified RAM between CPU and GPU in Apple Silicon. Laptops otherwise almost never have a GPU with sufficient RAM for LLMs.
1 comments

Should have been clearer. I was thinking of a dedicated in-house LLM server I could use from different laptops.