|
|
|
|
|
|
by JimWestergren
4819 days ago
|
|
|
Yes meta noindex is the standard way. But what if you don't want to waste server resources in bots crawling thousands of meta noindex pages? Perhaps you are using some heavy SQL queries on those pages. You can block crawling with robots.txt but then Google won't see the noindex and URLs will be indexed. If you block and send a 404 to bots I think that's fine. They will see a blank page - nothing to gain from that in ranking. So cloaking, perhaps yes, but I don't think it would be risky. |
|
|