i know it's a joke, but the usb logo on the plug is always on top, so you can just orient it 'up' according to the underlying board (up for laptops, and facing left for desktops)
The side of your case that has the motherboard's backplate (where you plug everything in) is the bottom. On the vast majority of towers, the plate is on the right side, meaning left is up.
EDIT: right/left when looking at the front of the case.