[1024core]

> Memory Boost for LLM Capacity Requirements: 128 gigabytes (GB) of HBMe2 memory capacity, 3.7 terabytes (TB) of memory bandwidth ...

I didn't know "terabytes (TB)" was a unit of memory bandwidth...

[throwup238]

It’s equivalent to about thirteen football fields per arn if that helps.

[gnabgib]

Bit of an embarrassing typo, they do later qualify it as 3.7TB/s

[SteveNuts]

Most of the time bandwidth is expressed in giga/gibi/tera/tebi bits per second so this is also confusing to me

[sliken]

Only for networking, not for anything measured inside a node. Disk bandwidth, cache bandwidth, and memory bandwidth is nearly always measured in bytes/sec (bandwidth), or NS/cache line or similar (which is mix of bandwidth and latency).

[nahnahno]

About as relevant a measure of speed as parsecs