[tgma]

Check out relatively recent Google TPU paper where they used an optical switch to connect neighboring TPUs

https://arxiv.org/pdf/2304.01433