[madeofpalk]

How is not posting it publicly consenting to it being available publically?

[froh]

Yes. It's simply concludent. If you post on a public website you consent it can be crawled. Duh.