It’s crazy that the Ethernet chips consume more power (presumably - because of the heat) than the processor in the computer. How is driving 25Gb/s such a hot task compared to driving multiple 40Gb/s Thunderbolt ports?
As I understand it, it takes a bit of anger to get electromagnetism to wiggle that fast over copper. Imperfect transistors using their full operational envelope to control a sort of chaotic thing? Fields and stuff.
can confirm. anger causes loud fast communication that can be heard over background noise. I've heard anger using light-based signalling like sign language might be more efficient.
They’re not that bad, but even a couple watts of power with no way to dissipate is going to get hot enough to burn you. Forced air cooling over a heatsink is really effective. 15W under load is much lower than a high end desktop CPU that can pull 150-200W.
See also NVMe drives? They draw enough idle power to drain a laptop battery overnight, and will easily hit 60+C in a bad enclosure. That’s only a 10Gbps module. The USB4 enclosures are all heatsink.
I might be hallucinating, but IIRC this is now dependent on PCIe revision. More recent revisions have removed the slot power limits line, and so it works out that in theory a x4 slot (or any other size) can have a 75W load. IIRC this is stated in the middle of a giant section on up/down plugging.
(but its also displayed in the pcie PowerLimit capabilities you can see with lspci)
For a 25G NIC, I’d be perfectly unsurprised if it demanded an x16 slot. I’d be more surprised if it didn’t have a power connector like a video card, though.
Maybe the NIC does a lot? In past experience, a whole Xeon CPU couldn't keep up with a 10gig NIC if it was sending/receiving min-size UDP packets. Even with Intel DPDK iirc.
There are no shortcuts in networking. It's quite easy to spend a 2-3x+ premium on a switch or adapter capable of non blocking line rate on every port simultaneously only to then have it fall over to a fraction of that in the form of lots of tiny packets. This is why we have things like QoS, flow control, and ECMP
It's distance. 25GbaseT is good for 30m+. Thunderbolt is good for 1m without active cables. Making the much more rugged signal is a much more intense job.
And your computer already speaks the PCIe and thunderbolt. It has that probably on CPU. Here we have to receive USB, convert it to Ethernet. On much less up to date process nodes than your CPU.
Third, until very recently for even 10Gbit it meant using a usb4<->pcie bridge chip which itself was hot, to provide a generic pcie connection, which then talked to a conventional network chip, so it was a double hop: USB <-> pcie <-> nic. I don't know if 25Gbit to USB direct convert is available yet but we've seen a wave of vastly cheaper 10Gbit adapters come out that are single chip USB<->nic, probably not pcie at all, that are much much cooler. 25Gbit is probably still not here yet, maybe?
Ethernet is isolated through transformers on the physical layer and they're always sinking power. Thunderbolt is just pushing current directly through.
With ethernet it's for lots of reasons but a big one is not creating ground loops between distant equipment. If you didn't isolate the network cable would be sinking potentially amps of current between distant devices and that just isn't sustainable. You don't have this problem attaching USB between two devices.