Some do, some don't.
https://www.theregister.com/2023/07/27/thames_water_to_datac...
> Not all datacenters use water for cooling, but of those that do, a large facility might use anywhere between 1 million and 5 million gallons of water a day