Have you tried WSL? The NVidia developer CUDA repo has a specific folder for "wsl-ubuntu" where you only install the toolkit and it reuses the Windows graphics drivers IIRC.
Yes. I did do for a while but it used to involve very specific CUDA versions and other dependencies which I found restricted what I could do outside of WSL. I was waiting for it to settle down.
I believe it has in Windows 11 but I'm holding off on that because it's still unstable for some VR usage.
I believe it has in Windows 11 but I'm holding off on that because it's still unstable for some VR usage.