[brugidou]

We had an interesting incident where one of our datacenter temperature sensors kept on rising, and operators on site could clearly hear the noise increase of all servers going to max fan speed following a BMC "crash" triggered by a network loop on our IPMI lan.

It took us a while to identify the issue and all systems were running fine, but we had to shut down many racks to avoid the temperature to rise too high.