Hacker News new | ask | show | jobs
by toomuchtodo 1893 days ago
Why not both?
1 comments

Because wouldn't they have to keep adding new techniques to the list continuously when in the other case they can say in what format the content needs to be available in.
Indexable is open to interpretation. No disallow directives in robots.txt isn't.