Hacker News new | ask | show | jobs
by etaioinshrdlu 1509 days ago
Can 3090 GPUs share their memory with one another to fit such a large model? Or is the enterprise grade hardware required?
1 comments
coolspot 1509 days ago
Yes, two 3090s ($1.7k each) can be connected via NVlink with common 48Gb of memory pool.

Two RTX A6000 ($4.5k each) can form 96Gb memory pool.

link