Hacker News new | ask | show | jobs
by randunel 425 days ago
Do you or do you not visit and respect "robots.txt" on the hosts you've mentioned in your blog post as downloading via next.js?