[GIFtheory]

Interesting that this has 7x the cores of a M1 Ultra, but only 25% more memory bandwidth. Those will be some thirsty cores!

[ZetaZero]

M1 Ultra bandwidth is for CPU and GPU (800GB/s). Grace is just the CPU. Hopper, the GPU, has it's own memory and bandwidth (3 TB/sec).

[my123]

https://twitter.com/benbajarin/status/1506296302971334664?s=...

396MB of on-chip cache… (198MB per die)

That’s a significant part of it too.

[wmf]

The M1 memory bandwidth is mostly for the GPU but Grace does not include an (on-chip) GPU.

[Teknoman117]

The CPU complex on the M1 series doesn't have anything close to the full bandwidth to memory that the SoC has (like, half). The only thing that can drive the full bandwidth is the GPU.