Y
Hacker News
new
|
ask
|
show
|
jobs
by
jefposk
78 days ago
The LLM scraper bots ignore robots.txt