Hacker News new | ask | show | jobs
by asamil 4082 days ago
I had to pull the data out of Marvel's API which returns JSON. Then the data was stored in Orchestrate.io as the database. The JSON data is included in the repo so other people don't have to scrape Marvel's API.
2 comments

Did you get special permission to do this? It is against the generic terms:

http://developer.marvel.com/terms

Use of our Content. You may not change or edit the Content (e.g., modify, augment). You agree to follow Marvel's attribution and linking rules, as set forth here: http://developer.marvel.com/documentation/attribution. You also agree to delete any Content upon Marvel's request (or if Marvel disables the Marvel API (or upon termination, see below)). You agree to configure your Apps to request only Content that is needed by such App. You may not (except with Marvel's prior written approval): (i) use any Content, or the Marvel API or Tools for any commercial purpose; or (ii) redistribute the Content or Tools except within your Apps.

Storage. You may not indefinitely cache Content and further agree to follow the content retention rules, as set forth here: http://developer.marvel.com/documentation/attribution.*

Generally, you don't "scrape" an API.. the point is that you use the API. That way the information is always up to date.

You can do all of this and still stay within the terms of service.