[svdree]

You can, if the scene fits into GPU memory. Otherwise the data transfers will quickly dominate your render time.

[Asooka]

I wonder if chips like the new Intel with AMD integrated GPU would change things. You should be able to simply hand off memory to the GPU to do its thing and read the result by just mapping physical pages back into your address space.