Same deployment scenario here (home assistant on libvirt, usb pass through) and my Conbee 2 has been rock solid, with xiaomi buttons, temp probes and door sensors.
Same. Latest firmware is stable for me, made sure to select a channel that didn't interfere with any wifi networks, and put it on an extension cable. Extremely stable now.