[miloshh]

The GPU cores share RAM, so there is no need to have local copies. Though if you run out of the 4GB available on Tesla/Quadro cards, it gets more complicated (but so would it on the CPU).

[liuliu]

I think that it is more relevant to the memory bandwidth (hundreds cores trying to access the same big chunk of memory).