[OJFord]

That's exactly what GP is talking about, the 'guesswork' comes in when you upscale as a function of only the downsampled version.