|
|
|
|
|
by xiongchiamiov
4995 days ago
|
|
Hmm, that's interesting. I don't think so, though, because the user-agent on the requests is the googlebot: From: googlebot(at)googlebot.com
User-Agent: Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)
|
|
At Blekko we post process extracted pages of the crawl which, if they were putting content behind js could result in js calls offset by the initial access but 3 days seems like a long time. Mostly though the js is just page animation.