Hacker News new | ask | show | jobs
by robertlagrant 813 days ago
Would it not be possible to create a search engine that only crawls certain sites?
1 comments

I was most interested in the offline aspect of it, which I wouldn't know where to even start with if I were to fork.

How do you parse and efficiently store large, unstructured information for arbitrary, unstructured queries?

You put it in a search server, like ElasticSearch or Meili.