Hacker News new | ask | show | jobs
by MacsHeadroom 1149 days ago
llama.cpp has preliminary support already. https://github.com/ggerganov/llama.cpp/issues/1063#issuecomm...