|
|
|
|
|
|
by paul_n
942 days ago
|
|
|
Actually, consider that the commenter may have helped un-obfuscate this world a little bit by saying that it is in fact easy. To be honest the hardest part about the local LLM scene is the absurd amount of jargon introduced - everything looks a bit more complex than it is. It’s really is easy with llama.cpp, someone even wrote a tutorial here: https://github.com/ggerganov/llama.cpp/discussions/2948 . But yes, TheBloke tends to have conversions up very quickly as well and has made a name for himself for doing this (+more) |
|
|