[smw]

Because bandwidth between those sticks and the GPU isn't fast enough for fast inference.

[xyzsparetimexyz]

Even with an integrated gpu? Surely it'll be faster that using thunderbolt cables

[cyanydeez]

both AMD and Apple hit the unified memory goal. but its the bandwith thats bottlenecking their performance and onboarc memory is even worse.

[xyzsparetimexyz]

Is Apple in a better position than Amd as this article seems to claim?

[wtallis]

AMD's Strix Halo has a 256-bit memory bus. Apple's Max class chips have a 512-bit memory bus, Ultra class chips have a 1024-bit memory bus. Unless you want to go for datacenter hardware, AMD's offerings simply aren't in the same league in terms of memory bandwidth.

[xyzsparetimexyz]

I see, interesting thank you

[cyanydeez]

depends: if they can keep getting larger memory, yes