Unfortunately I have to use that driver to support the external monitors on my laptop because the display ports are directly wired to the nvidia GPU and the open source one doesn't work at all for me.
Stuff like this is why I haven't decided. Hopefully the new Arm laptops like the Pinebook or MNT reform will (eventually) provide better integrated experience. That route would be a lighter laptop + long battery mainly to remote into an amd ryzen desktop. LTE connectivity is pretty amazing these days. Though Apple still wins for fit and polish..
I have the same problem. Luckily working from home means I don't have to touch my laptop any more and I can instead use the rx580 in my desktop, haven't really had any graphics problems with the AMD open source drivers.