This is why the DEL key is all ones. It was used to overpunch the wrong letter on a paper tape and replace it with a character that meant ignore (delete) it.
Yup, I talked about this (and the origins of ASCII and why Ctrl+M is new line etc) in a talk I gave at the end of last year entitled "A brief history of Unicode". The video recording has just been published on InfoQ: