Hacker News new | ask | show | jobs
by srobertson 4905 days ago
Let me double check that for you. Were you using a valid aws-id and secret?
1 comments

No, usually you can download them without sending any aws-id if they are on the Public Datasets S3 bucket, e.g.

    wget https://s3.amazonaws.com/aws-publicdatasets/common-crawl/crawl-001/2008/06/19/0/1213886083018_0.arc.gz