Y
Hacker News
new
|
ask
|
show
|
jobs
by
sshumaker
40 days ago
Are you serious? It’s multiple nodes to run a frontier model (a node is 8x GPUs), and they aren’t running on H100s. You are looking at 32+ GPUs.
1 comments
scheme271
33 days ago
I was being pretty generous to the comment I was replying to. Needing 32+ H100s just strengthens my argument that people aren't going to run frontier models locally anytime soon.
link