Eventually they'll be put in robots able to gather real-world data live, and they'll have a practically infinite amount of video/audio/tactile data to learn from.
Sure, but this scales rather poorly. How many robots do you expect, and don't you expect some resistance from the public, for privacy reasons at the least?