Hacker News new | ask | show | jobs
by geuis 868 days ago
I'm working on a blog post documenting what I've been doing as a newcomer to llama.cpp and the mixtral model. The steps can apply to any model really. Its mostly about optimization steps I'm experimenting with. Be warned its all new to me and my explanations may not be entirely accurate yet, as I'm still learning the lingo so to speak.

The blog is at https://geuis.com. I'll try to wrap it up today or tomorrow and get the post out.