https://en.wikipedia.org/wiki/Comparison_of_deep_learning_so...
https://gpuopen.com/compute-product/miopen/
From reading these articles the consensus is that if need speed now and can't wait use an NVIDIA while AMD plays catchup. Who knows how long this situation will last.