[jono_irwin]

hey cosmotic, we're not really advocating for storing model weights in the container image.

even the smaller nvidia images (like nvidia/cuda:13.1.1-cudnn-runtime-ubuntu24.04) are about 2Gb before adding any python deps and that is a problem.

if you split the image into chunks and pull on-demand, your container will start much faster.

[fwip]

Just pre-install the NVIDIA layer on the filesystem instead of docker-pulling it for every single machine.