Hacker News new | ask | show | jobs
by BiteCode_dev 847 days ago
The problem is crawling is generally optimized with info you find in the page.