[pdpi]

> It is as related to "Agentic $whatever" as your toaster is related to it

These things have hardware FP8 support, and a 1.8TB/s full mesh interconnect between CPUs and GPUs. We can argue about the "agentic" bit, but those are features that don't really matter for any workload other than AI.

[pezezin]

The huge interconnect would also useful be for HPC tasks. The FP8 not so much, HPC still loves FP64.

[dmitrygr]

mem bw between cores matters for .... literally all workloads that are not single-core (read: all). And FP8 matters not at all cause inference on cpu is too slow to be of any use whatsoever in the days of proper accelerators

[kibibu]

Would cloud gaming platforms benefit from the interconnect?

[pdpi]

Don't think they would. Games aren't nearly as hungry for memory bandwidth as LLMs are. Also, I expect that the VRAM/GPU/CPU balance would be completely out of whack. Something would be twiddling its thumbs waiting for the rest of the hardware.