Just don't accidentally stick USB-C into a USB-A port. It will fit and it will short the port, causing the machine to crash. Speaking from experience...
Once when I boarded a flight I noticed one of those multi-country mains power sockets next to a 2-hole headphone socket. They were arranged and aligned in a way that made it obvious that a 2-prong headphone cable would fit in the power socket. I took a picture of it and put it on Facebook before taking off.
After a nap I actually did put on headphones and plug them into the power socket by mistake. Luckily nothing happened.
I think most people in the US have stuck a finger between the two completely uninsulated prongs of a plug and got a shock, usually during childhood. They usually only do it once.
While you're at it, also don't accidentally plug a computer's Ethernet port into an rj45 wall plate that connects to an analogue pabx, it will fit and it will fry the NIC.
Don't put shit in the wrong hole is really one of the most basic lessons we should teach people in life.
On my computer, the USB-C port is at the back -- one time, I shorted the motherboard out due to trying to insert a USB-C cable without looking. Only did it once, but learned my lesson.
Typically I get it wrong 100% of the time, i.e. I was in the right orientation but misaligned so it does not work, so I flip it, fails again, and then I swear and flip it a second time.
If you get it wrong 50% of the time let me substantially reduce that for you: logo goes 'up' for whatever the normal orientation of your device is. That should clear up 99% of the cases.
I had a Cooler Master case where the IO stack at the top of the case had the opposite orientation (logo down). Threw me off forever.
I'm at a point in my life where I've just given up and figure that I'm only going to get it right 1/3rd of the time anyway: Nope, turn; nope, turn; yup.
Eww that's weird, ok in your case you are out of luck. That's pretty strange though, I have a ton of USB-A devices here and they are all in line with the way I outlined. So that's a bit of a surprise but it may well be an exception.
As for the ones that are sideways: the 'bottom' of the case is the bottom of the motherboard, so if you think of it that way it might still work for all but the top side ones.
I use a docking station to help give me dual monitors on both Mac & Windows. Some monitors don't work in Mac. Maybe I need to get a new docking station.