Hacker News new | ask | show | jobs
by Atlas-Marbles 1038 days ago
Very cool, this looks like a combination of chatbot-ui and llama-cpp-python? A similar project I've been using is https://github.com/serge-chat/serge. Nous-Hermes-Llama2-13b is my daily driver and scores high on coding evaluations (https://huggingface.co/spaces/mike-ravkine/can-ai-code-resul...).
1 comments
netdur 1038 days ago
no not llama-cpp-python, it uses llama.cpp's built in server.
link