[imranq]

I found this tool to be interesting to play with and seems to work pretty well assuming you stay in the same position: https://gazerecorder.com/

I'm guessing a combination of projection mapping, built in lighting, and some crowdsourced data will get accuracy to very usable levels