Git handles binaries perfectly fine. Your repo is gonna get big fast, and it isn't going to handle merges, but if you just want a linear version history and are used to git, you might as well use it.
He probably means to add the project file to the versioning system and commit regularly so that you can rollback to a previous version. It's way less flexible than Undo though.