Y
Hacker News
new
|
ask
|
show
|
jobs
by
adastra22
361 days ago
Any computer with a display has a GPU.
1 comments
om8
361 days ago
Sure, but integrated graphics usually lacks vram for LLM inference.
link
adastra22
361 days ago
Which means that inference would be approximately the same speed (but compute offloaded) as the suggested CPU inference engine.
link