Hacker News new | ask | show | jobs
by zoe_dk 931 days ago
Noob question - how might I call this from my Python script? Say as a replacement gpt3.5 turbo of sorts. Is there an option without GUI?

This is great thank you, very user friendly (exhibit a: me)
1 comments
simonw 931 days ago
The llama.cpp server version runs a JSON API that you can call. It's currently missing any documentation though as far as I can tell - I found dome details on Reddit: https://www.reddit.com/r/LocalLLaMA/comments/185kbtg/llamacp...
link
zoe_dk 931 days ago
Thank you Simon I will check it out.
link