TL;DR: I'm using https://github.com/Gerharddc/litterbox to sandbox all my development these days and have now managed to get the ROCm variant of PyTorch running with GPU access inside a Litterbox. If you'd like to see the details of how to achieve that, this post is for you!