Hacker News new | ask | show | jobs
by psydvl 1363 days ago
While scrapping Google follows robots.txt file rules
1 comments

https://www.youtube.com/robots.txt

Looks like scraping is allowed then, if your robot is named "Mediapartners-Google*" And you can name your robot whatever you like (there's no legally enforced nor defacto registry), so my robot:

"Mediapartners-Google-im-cleary-not-a-member-of/1.0"

Can legally scrape anything on google's youtube. Perfect.