Hacker News new | ask | show | jobs
by wslh 410 days ago
> so googlebot wins because they’re the dominant search engine.

I think it's also important to highlight that sites explicitly choose which bots to allow in their robots.txt files, prioritizing Google which reinforces its position as the de-facto monopoly. Even when other bots are technically able to crawl them.