This was a flaw on the Nokia N900. Or at least, on some of the devices.
I solved the issue by using TOPK magnetic cables. The magnet would remain in the port (microUSB, lightning, or USB-C, not sure about miniUSB but I got like one device which uses that), and all the cables would work with it. I even leave them connected (the LED does not draw much power and I got solar anyway) which allows me to quickly start or stop charging a device. Which, given I got quite a few, is very useful. Another issue is I keep getting leftover microUSB but need more and more USB-C for which the feature isn't very important (the more USB-C I'd have, the easier it'd be to stop using magnetic cables).
The exception is my MBP as it has a MagSafe (v3, my wife's MBP and my old MBP having v2) but I forgive Apple for that; its very useful and probably where TOPK got their inspiration from.
https://news.ycombinator.com/item?id=36927409