Hacker News new | ask | show | jobs
by nutanc 1247 days ago
The search piece can be self hosted and can be compliant etc. But the generative piece is a little harder to do. The models are really big if you need good quality output and the best models are closed APIs.

In my experiment for our web site, https://speech-kws.ozonetel.com/ozosearch, the search piece is self hosted(know more links). But the generated answer is given by OpenAI API.