Hacker News new | ask | show | jobs
by wuyishan 1731 days ago
how does the crawling works, if the URLs content is behind logins or similar?
1 comments
nikvdp 1730 days ago
Hey wuyishan, right now it isn’t able to retrieve the full text of content that’s behind login walls, but we are looking at ways to allow it to handle those sites as well
link