I'll add that S3 is only slow to delete things sequentially. You can delete or write an effectively infinite amount of items in parallel.