Hacker News new | ask | show | jobs
by ranger_danger 702 days ago
llama.cpp supports being an OpenAI API server, you would just need to change the URL in the Tegon source.