Y
Hacker News
new
|
ask
|
show
|
jobs
by
swiftcoder
6 days ago
is 16Gb "lots of RAM" in an LLM world? How many of these would you need to stack on a motherboard to inference a decent size model?
1 comments
oblio
6 days ago
At least 4, probably 6+.
link