[xsamgreen]

Definitely agreed that CPU is a natural baseline. But there are promising results for implementing NTT on GPUs. Here is something recent https://eprint.iacr.org/2021/124

Nothing will beat an ASIC for NTT though.