One of the maintainers here. I am looking at improving this more. With av1 we can get even better latency at 4K, the problem is that it is not supported on Safari for old devices, so I am looking into getting the stream in rust and sending it to the frontend via a local ws server, surprisingly to me the added transport latency is less than 5ms.
Thanks for the heads-up. Also it would be great to be able to quickly switch "pairs". Currently Gather is switching their license so many people might be looking for alternatives. We don't need no running around on maps but having the ability to quickly jump between groups would be awesome.