Y
Hacker News
new
|
ask
|
show
|
jobs
by
throwaway675309
1076 days ago
What? It's only one file, and it definitely looks like it's using openAI to make the actual queries.
qa = ConversationalRetrievalChain.from_llm(OpenAI(temperature=0.1), db.as_retriever())
1 comments
sp332
1076 days ago
You can change the arguments to from_llm() to point to a local model instead. Example here:
https://huggingface.co/TheBloke/MPT-7B-Instruct-GGML/discuss...
link