|
|
|
|
|
|
by yeahwhatever10
582 days ago
|
|
|
CUDA is one part, but another part of Nvidia's lead is their focus on bandwidth both memory and GPU-GPU communication. AMD dramatically falls behind Nvidia in training because of its terrible collective times (AllReduce, AllGather, etc.) |
|
|