[jranck]

This looks great. I'd love to find out more about your API and what type of web scraping techniques you're using. It looks like this is going to be available publicly to developers? What type of usage do you guys allow?

[miket]

I'd be happy to talk about the visual-based statistical classification technology in a follow-up blog post if there's interest.

[kmfrk]

There is(!)

As someone who's right in the middle of Mining the Social Web, this almost seems too coincidental to be true.

[jamongkad]

I'm an interested party as well. As a student of machine learning I would love to learn the techniques you've applied. I'm doing a data mining startup and this would be very helpful.

[alextp]

Visual classification sounds interesting. So you render the page and use location-based features to extract content?

[miket]

In short, yes. The key innovation is that we've come up with a lossy, fixed-length representation of the visual features that we can use to do classification upon. I'll try to do a more detailed writeup on our blog when I find some time.

btw, our blog has no rss feed, but you can just use our RSS API :-) http://www.diffbot.com/api/rss/http:/www.diffbot.com/blog

[itsnotvalid]

+1 for good computer science writeups