Hacker News new | ask | show | jobs
by voxxit 5735 days ago
I just recently implemented this. The thing I'm having trouble with is the fact that they don't limit the amount of time (or specify a limit, rather) which is acceptable to make the crawler wait. For instance, what if it take 20 seconds to load an acceptable amount of JavaScript-created HTML?