There aren't any open source CUDA apps that do transcoding, so far they are all Windows apps. And non-scriptable ones at that, which rules out web scale.
My point isn't so much picking something off the shelf, its more develop something for yourself. If "web scale" means that the ROI is greater then development effort plus hardware acquisitions compared to your current system then do it.