[choppaface]

Here is how hard it is to serve and use LLMs: https://github.com/ggerganov/llama.cpp

[doctor_eval]

“The original implementation of llama.cpp was hacked in an evening.”