Cool! I've used a similar workflow with teams that SSH into boxes with GPUs, VSCode makes it completely seamless - surprised i don't hear about it more
Kind of, I used to run code server but you miss out on plug-ins and other custom settings. Connecting via SSH is seamless. You can copy from local -> remote, keep your plug-ins and access from any machine with VS Code.