Hacker News new | ask | show | jobs
by gepiti 618 days ago
Tried to use the example on the documentation:

llama_init_from_gpt_params: error: failed to create context with model 'Meltemi-7B-Instruct-v1.5-Q8_0.gguf' main: error: unable to load model

Is something missing?

1 comments

I guess you mean the .gguf examples, not Llamafile, right? What command did you use? Maybe you're using an old llama.cpp ?
Installed from the link to AlmaLinux 9. The command is from the CLI example: ./Meltemi-7B-Instruct-v1.5-Q8_0.llamafile -p 'Ποιό είναι το νόημα της ζωής;'

Thank you very much.