Hacker News new | ask | show | jobs
by paganel 1265 days ago
> In 2004 I built my own web crawler and RSS feed reader in PHP in an attempt to build my way out of the information problem.

I've built and actively maintained a Django- and Solr-based personal project to store all my info about the DVDs that I was hording around 2007-2010, it also involved crawling IMDB. Did the same with the anime shows I was also hording, in this instance I was crawling animenewsnetwork.com.

After a very long hiatus I feel that I should do the same with the physical books hording that has gotten over me since the pandemic started (this time using Elasticsearch instead of Solr), after all categorising books is from where facet-search libraries like Solr first got their hints.

1 comments

Looking through the comments on this post, it's no surprise that many HN readers are doing the same. A self selected audience, I guess ;-)

Still, it has been fun, and rewarding. I don't feel like building these things is a waste of time, seriously.