[solveforall]

Ah, I get it now. Thanks for the explanation. This is the problem with the "deep web" not being indexable by crawlers. I've started looking at how to make this easier for users. Basically I'm got some ways to detect which sites should be searched in response to your queries, based on the category of words in your query and the site. But then I need to do a real-time search of that site, that might require JS to run, extract the links, and present them back to the user. It might be slow, but it's easier for the user to wait for the cloud to do it than click the links on multiple sites himself.

Thanks for checking out my site. If you have any questions or have any trouble please let me know at [e-mail]. And maybe we can explore brainstorming/collaborating since you've clearly put a lot of thought into search.