I'm one of the creators of cmux. I'm moving a lot of my own dev work to Mac Minis, so I'm starting to feel quite a lot of the pain you mentioned... will try to make this better!
please do and let me know ! quick story fast, I'm working a loooot remotely. I'm using https://github.com/sanchxt/yoop to synchronize my keyboard. Since I'm using moonlight it's blazing fast. But when I work in the train I'm back to ssh. My quick tip would be to: build your own tools, build them once, use them forever. and rmux is exactly made for that, it's prefect for TUIs over ssh and low connection that needs to stay alive even if you get disconnected