I've found this little tool to be a huge timesaver for Middleman deployments to S3. Just remember to gitignore your environment variables ;)
https://github.com/fredjean/middleman-s3_sync