[geerlingguy]

Some of their marketing mentions no need for external DRAM, for example, from this CNX article[1]:

"One of the key reasons for the performance improvement is that RAM is self-contained without the need for external DRAM like other solutions. This decreases latency a lot and reduces power consumption."

Not sure how much RAM is included on the chip, but I'm also thinking in the tens of MB range, certainly not gigabytes.

[1] https://www.cnx-software.com/2020/10/07/learn-more-about-hai...

[alandarev]

PCIE is slower than DRAM, so not having DRAM is not a performance improvement, but a hardware limitation reducing the scope of usability. Though it doesn't mean bad - cheaper to produce, serving its own use cases.

Process a stream of data - yes. Machine learning on large set of data - no.

[geerlingguy]

I think what's implied by their marketing at least is that DRAM is included on the chip itself (unlike other solutions like GPUs with external RAM chips)... but the problem is that limits the amount of available RAM quite severely.