And to hash something needs reading all of its data. I think deducing the file size would actually be faster in some file systems and never slower with any.
Faster in all file systems I'd guess, stat is fast, opening the file and reading its contents and updating a checksum is slow, and gets slower the larger the file is.