Yes, any mmap'd file will be swapped in on demand, when a page is first accessed, it will not all be copied in physical memory at once. In case of memory pressure, pages will be removed from physical memory ("swapped out"), since they can be loaded back from the file again when needed.
Since the executable is mapped read-only, the pages loaded in physical memory can also be shared between multiple instances of the process.