Hacker News new | ask | show | jobs
by DeveloperErrata 462 days ago
Increasingly so. Many other popular inference tools in this space also expose an OpenAI compatible API: VLLM, Llama.cpp, and LiteLLM all do.