Hacker News new | ask | show | jobs
by stogot 529 days ago
How does it run 400B models across two? I didn’t see that in the article
3 comments

> Nvidia says that two Project Digits machines can be linked together to run up to 405-billion-parameter models, if a job calls for it. Project Digits can deliver a standalone experience, as alluded to earlier, or connect to a primary Windows or Mac PC.
Point to point ConnectX connection (RDMA with GPUDirect)
Not sure exactly, but they mentioned linking to together with ConnectX, which could be ethernet or IB. No idea on the speed though.