Hacker News new | ask | show | jobs
by mohi13 2872 days ago
BTW we had a question in general to anyone who can help us, Does hosting such a dataset cause issues with SEO etc? Anything else we should be aware of?
1 comments

Probably wouldn't be wise to host a dataset like this with "example" images embedded or linked where a search engine could find them.
thanks, will see how can I block crawl on this dataset. BTW how does it hurt exactly, couldn't find much except in case of safe-search mode.