https://github.com/satoshiiizuka/siggraph2016_colorization
And is this not the dataset:
http://places.csail.mit.edu
I'm really asking, because I've downloaded the project and skimmed the paper, but haven't had time to vet these assumptions. On the face of it, it seems everything is provided, but you've vetted it further and learned that isn't true?