There's also a way to get CUDA working in Docker by passing the device paths, which gitlab-ci-runner can also use.