[gearhart]

This is great work. Forgive me if I'm missing it, but since the blog post implies you're aggregating and cleaning the data from several lists, is there any way to see the latest additions (RSS etc?) rather than directly searching for individuals?

It would make it more useful for flagging up potential stories, as well as researching stories journalists are already writing.

disclosure: I work for a company that provides real-time data to journalists for story discovery, and I know we'd certainly be interested

[carlosp420]

I never thought of that, but certainly having a RSS feed is a great idea. I have not done it as the journalists have not requested it. So far they have been asking me for more spiders so Manolo would include visit records from other Peruvian institutions.

[gearhart]

If you do choose to implement it, please do let me know (email in profile), I'll definitely make sure we use it.

[predius]

Should be a fairly easy thing to do, this is Python and Scrapy!

http://stackoverflow.com/questions/28127396/creating-rss-wit...