[embedding-shape]

CUDA is only on nvidia GPUs, I guess a RTX Pro 6000 would get you close, two of them are 192GB in total. Vastly increased memory bandwidth too. Maybe two/four of the older A100/A6000 could do the trick too.

[deeviant]

RTX pro does not have NV-link, because money, however. Otherwise, people might not have to drop 40,000 for true inference GPU.