Hacker News new | ask | show | jobs
by JustExAWS 285 days ago
It’s never been a good idea to batch ingest a lot of little single files using any ETL process on AWS, whether it be DDB, Aurora MySQL/Postgres using “load data from S3…”, Redshift batch import from S3, or just using Athena (yeah I’ve done all of them).
1 comments

These weren't "little" single files... just separated by tld iirc.