Y
Hacker News
new
|
ask
|
show
|
jobs
by
DeveloperErrata
462 days ago
Increasingly so. Many other popular inference tools in this space also expose an OpenAI compatible API: VLLM, Llama.cpp, and LiteLLM all do.