[ocoster]

Did you know that we provide the complete set of questions and answers (from all sites, including Stack Overflow)?

No need to crawl anything.

You can find it on the internet archive:

https://archive.org/details/stackexchange

[aalear]

And there's also the API - http://api.stackexchange.com

[ocoster]

And the Data Explorer (use SQL in the browser to query the Stack Overflow database): http://data.stackoverflow.com

[Pica_soO]

Thanks, thats great..