Hacker News new | ask | show | jobs
by sp332 3991 days ago
They could at least have allowed the Internet Archive in the robots.txt, since the way things stand all www.twitter.com links will be unavailable from the Wayback Machine. That will obviously be a huge loss to researchers.
1 comments
sp332 3990 days ago
(Update: the Wayback Machine will be fine, using the twitter.com/robots.txt)
link