Do you think it would be possible to describe a binary file in such a way that some git extension of sorts could be made to understand the file so that only the minimum delta would have to be saved by git?
Probably, but what for? It doesn't seem feasible to support every common binary type, and are all common binaries even understood well enough to do this?