|
|
|
|
|
|
by rhdunn
50 days ago
|
|
|
What's the usecase for this API? My experience with running LLMs locally is spinnnig up llama-server (possibly on a separate machine) and then configuring other applications to point to that OpenAI compatible web server instead of OpenAI or similar. I don't want a web browser creating/running an LLM instance as that machine may not have the capability or capacity to run an LLM instance. |
|
|