Hacker News new | ask | show | jobs
by Kostic 845 days ago
It should be possible to run it via llama.cpp[0] now.

[0] https://github.com/ggerganov/llama.cpp/pull/5631

1 comments

Amazing how quickly this happened.