Hacker News new | ask | show | jobs
by jsheard 544 days ago
llms.txt isn't an opt-out signal like robots.txt, it's a way to provide a simplified version of pages that are easier for LLMs to ingest. It's more of an opt-in for being scraped more accurately.
1 comments

Or scraped inaccurately. It seems like you could have some fun with this if you were so inclined...