Hacker News new | ask | show | jobs
by mistermann 5821 days ago
Any particular libraries or techniques you used for the crawling / parsing, or just coded up something from scratch for each site you crawl? (I think I noticed you even do kijiji.)
1 comments

All of it is from scratch. Yep, I do Kijiji, but only in Canada, because I was told it's more important than CL in some parts there.