[indiv0]

They do containerize but it’s not enough. You still need the right drivers and CUDA stuff installed on the docker host, which can be finicky to setup. Not to mention figuring out how to get docker to actually pass the GPU to the container.

[analyte123]

I see this has not gotten any better in the last 5 years. For future reference, if you as a dev are interacting with a product that is this hard to use and there is no other option but to use it (CUDA), you should buy their stock.

[danuker]

I'd much rather look out for competitors.

Resting on laurels won't last. If a company stops improving its offer, a competitor might catch up.

[ceeplusplus]

The competition has even more broken software (AMD). At least Nvidia's works when you need it to.

[moffkalast]

I think OpenCL support has been getting better, and it may be possible to run a lot of models with it, but that just doubles your already frustrating amount of hours trying to set the damn thing up.

[boolemancer]

> Not to mention figuring out how to get docker to actually pass the GPU to the container.

Should just be passing `--gpus all` these days, shouldn't it?