These days they use special hardware accelerators: https://gwern.net/doc/cs/hardware/2021-ranganathan.pdf
These days they use special hardware accelerators: https://gwern.net/doc/cs/hardware/2021-ranganathan.pdf