[billconan]

Can their system attach memory? from what I read, it doesn't seem to be able to: https://www.reddit.com/r/mlscaling/comments/1csquky/with_waf...

[wmf]

I think they do have external memory that they use for training.

[anon291]

Former Cerebras engineer. At the time I was there, it could not.

[winwang]

Surprising. DRAM (and more importantly high-bandwidth DRAM) seems to be scaling significantly better than SRAM -- and I'm not sure if that could be seriously expected to shift.