[rapjr9]

One potential application might be fighting wildfires. Seems like it would be really useful if one firefighter could remotely monitor a dozen autonomous bulldozers that were given general instructions. Would have to acquire a different training data set I'd guess, but the same approach seems applicable, get the data from teleoperated bulldozers used to fight fires. Getting the bulldozers into the right area would require some transport, like a truck or heavy lift helicopter, though maybe mini bulldozers would also work.

You might be interested in the work of Peter Corke also, he's automated horizontal mine shaft loaders and huge drag line shovels in his research:

https://www.youtube.com/watch?v=YUb9_Ysd2Hw

I think he used a different approach than you do, using visual servoing to get feedback and data from a camera. Maybe there's some value in combining both approaches, learn to control a machine from an operator, and also keep track of what is being moved with a camera to add another layer of control.