[nradov]

Google still offers an enterprise intranet search product which will index anything you let it access.

https://cloud.google.com/products/search/