Hacker News new | ask | show | jobs
by adastra22 314 days ago
Any computer with a display has a GPU.
1 comments

Sure, but integrated graphics usually lacks vram for LLM inference.
Which means that inference would be approximately the same speed (but compute offloaded) as the suggested CPU inference engine.