And because the option to not index posts is enabled by default and a good chunk of the fediverse is opposed to indexing due to their irrational fear of bots:
https://fedsearch.io/
https://news.ycombinator.com/item?id=33546937
https://www.reddit.com/r/Mastodon/comments/131amhl/why_are_s...
> Due to extreme backlash from the Mastodon community we decided to end the project, it is obviously not wanted by server admins.
> Due to extreme backlash from the Mastodon community we decided to end the project, it is obviously not wanted by server admins.