Y
Hacker News
new
|
ask
|
show
|
jobs
by
adastra22
314 days ago
Any computer with a display has a GPU.
1 comments
om8
314 days ago
Sure, but integrated graphics usually lacks vram for LLM inference.
link
adastra22
314 days ago
Which means that inference would be approximately the same speed (but compute offloaded) as the suggested CPU inference engine.
link