Hacker News new | ask | show | jobs
by ericintheloft2 2798 days ago
Off topic, but how does this work? How can the crawlers bypass the paywall?
1 comments
eru 2797 days ago
They explicitly allow eg the Google crawler. Not sure about others.
link
ericintheloft2 2797 days ago
Oh ok! Thx for explanation
link