[coolspot]

> so 30 12gb gpus - a 3090 will cost around $1800

3090 has 24Gb, thus 15 GPUs X $1800 = $27,000 in GPUs

[etaioinshrdlu]

Can 3090 GPUs share their memory with one another to fit such a large model? Or is the enterprise grade hardware required?

[coolspot]

Yes, two 3090s ($1.7k each) can be connected via NVlink with common 48Gb of memory pool.

Two RTX A6000 ($4.5k each) can form 96Gb memory pool.