Hacker News new | ask | show | jobs
by f38zf5vdt 896 days ago
The X-Robots-Tags header already exists as "noai" and "noimageai". Scraping software like img2dataset respects these by default.