|
|
|
|
|
by leminimal
843 days ago
|
|
Thanks, I'm glad to see your time machine caught my comment. I'm using the 32-bit GGUF model from the Google repo, not a different quantized model, so I could have one less source of error. It's hard to tell with LLMs if its a bug. It just gives slightly stranger answers sometimes, but it's not completely gibberish. or incoherent sentences or have extra punctuations like with some other LLM bugs I've seen. Still, I'll wait a few days to build llama.cpp again to see if there are any changes. |
|