Hacker News new | ask | show | jobs
by smlacy 51 days ago
> TPU 8i pairs 288 GB of high-bandwidth memory with 384 MB of on-chip SRAM

Wow. Just Wow. I presume that's for each chip, and there are 1152 chips in a pod so that's 331TB HBM and 442TB SRAM per pod. Just wow.

1 comments

That would be 442GB not TB of SRAM.

Aggregating on-chip SRAM is not a useful metric. AFAIK there are no interconnect between two chips at SRAM level so they cannot be shared .