Git is getting better with large files (now that changes to those are streamed to packfiles), but there's still some way to go to make it scale to large numbers of tracked files; https://git.wiki.kernel.org/articles/g/i/t/GitTogether10_bup... has some ideas to make the index more scalable.