[killingtime74]

What's the easiest way to adapt this to local LLMs like Ollama or Lama.cpp

[chpatrick]

Probably with https://github.com/BerriAI/litellm

[addandsubtract]

liteLLM looks like a tool that wraps various providers into an OpenAI API format, or is there more to it? What if I'm more interested in the PDF indexing(?) using ollama? Do you know of any tools that allow me to upload/include PDFs in my ollama chats?

[lolinder]

There are a bunch of little projects that do this. It's on the roadmap for ollama-webui (but not implemented yet), and Ollama published a guest blog post with a simple implementation that can be cloned and run very easily:

https://ollama.ai/blog/building-llm-powered-web-apps

There's also Cheshire Cat, which is a framework for building chat assistants that use a set of documents as a knowledge base:

https://github.com/cheshire-cat-ai/core

[chpatrick]

pdftotext?

[killingtime74]

thanks!