[mimsee]

Because wouldn't they have to keep adding new techniques to the list continuously when in the other case they can say in what format the content needs to be available in.

[pseudalopex]

Indexable is open to interpretation. No disallow directives in robots.txt isn't.