[nodja]

Loading here refers to loading from VRAM to the GPUs core cache, loading from VRAM is extremely slow in terms of GPU time that GPU cores end up idle most of the time just waiting for more data to come in.

[frabcus]

Thanks, got it! Think I need a deeper article on this - as comment below says you'd then need to load the request specific state in instead.