Hacker News new | ask | show | jobs
by dakiol 882 days ago
Is there something for the opposite? I don't want google (or any other scrapper) to index my website. Afaik, robots.txt is not authoritative.
1 comments
speedgoose 882 days ago 

    sudo iptables -A INPUT -p tcp --dport 80 -j DROP
    sudo iptables -A INPUT -p tcp --dport 443 -j DROP
    sudo ip6tables -A INPUT -p tcp --dport 80 -j DROP
    sudo ip6tables -A INPUT -p tcp --dport 443 -j DROP
That should do.
link