|
|
|
|
|
|
by coolspot
642 days ago
|
|
|
They provide that with base URL parameter: --api_base_url: You can use this flag (or the OPENAI_BASE_URL environment variable) to pass a different API URL from the default "https://api.openai.com/v1". This allows you to use other OpenAI-compatible LLM providers like TogetherAI, self-hosted vLLM or Ollama, etc. |
|
|