Hacker News new | ask | show | jobs
by swiftcoder 6 days ago
is 16Gb "lots of RAM" in an LLM world? How many of these would you need to stack on a motherboard to inference a decent size model?
1 comments

At least 4, probably 6+.