Hacker News new | ask | show | jobs
by t0 4565 days ago
But /x? is for the next page.
1 comments
pedrocr 4565 days ago
So apparently you can get two pages of ranking, using / and /news2.
link
randomdata 4565 days ago
Depends on the intent. If it is user-initiated (like say a mobile formatted version of the site), it wouldn't have to be obey the robots.txt, since it is not a crawler, just another web browser.
link