Some old PCMCIA cards used to have pop-out RJ45 connectors where the cable plugged vertically into a square open-ended socket. While making this design durable seems difficult, I'd still appreciate having an Ultrabook that didn't require a dongle.
Similarly, the latest model of Vaio Z has an ethernet port taller than the body, with a plastic cover that folds open to accept the full height of connector.