[Marwy]

How do they do that? I can't really figure out anything apart checking user agent (for web crawlers?)

[heroic]

you can simply check for the accepts header.