Hacker News new | ask | show | jobs
by hathawayp 3178 days ago
It should stick the subdomain you specify in the start URL, unless there is a redirect or something. Other subdomains won't be crawled, although it will HTTP status check links to subdomains. So possibly that is what you saw in the URL log on the crawl progress page?

If you want me to take a closer look send the subdomain over to support@sitebulb.com and I'll see what's going on.