[visionscaper]

Interesting, thanks for sharing this.

Apparently they are going to use “HIP” to convert CUDA applications to be able to run on AMD:

> The OLCF plans to make HIP available on Summit so that users can begin using it prior to its availability on Frontier. HIP is a C++ runtime API that allows developers to write portable code to run on AMD and NVIDIA GPUs. It is essentially a wrapper that uses the underlying CUDA or ROCm platform that is installed on a system. The API is very similar to CUDA so transitioning existing codes from CUDA to HIP should be fairly straightforward in most cases. In addition, HIP provides porting tools which can be used to help port CUDA codes to the HIP layer, with no loss of performance as compared to the original CUDA application. HIP is not intended to be a drop-in replacement for CUDA, and developers should expect to do some manual coding and performance tuning work to complete the port.

Would this one day lead to a HIP based PyTorch? I hope so!

[ajtulloch]

Good news! https://pytorch.org/docs/stable/notes/hip.html

[slavik81]

> Would this one day lead to a HIP based PyTorch? I hope so!

https://hub.docker.com/r/rocm/pytorch

[paulmd]

you can think of HIP as being a fancy batch script to convert CUDA to OpenCL and it works about as well.

If you're going to have to re-debug it anyway, what's the point? AMD's focus certainly should have been on something like GPU Ocelot or compiling PTX to GCN/RDNA instead.