It has to do with the binfmt_misc configuration on the podman machine VM, which is used on non-Linux hosts like macOS. I've proposed that they update the machine VM configuration to fix the inconsistency with Docker Desktop but the conversation petered out.
Solution: https://stackoverflow.com/a/77354286/145504
Discussion: https://github.com/containers/podman/discussions/20445