[cypress66]

Ooof. I'd expect this to cost like 5 bucks on runpod using a single 3090.

I use axolotl for training, I didn't check your notebook but axolotl likely comes with more optimized defaults for speed and vram than what you're doing.