[julien_c]

quite cool! haven't tried it yet, but what's the latency on hot-loading a model? (for instance, loading `stabilityai/stable-diffusion-2-1` for the first API call)

[nikola_borisof]

Because this is popular model and many people use it, you will not experience the cold-start latency most likely. But in general it is <10s.