|
|
|
|
|
by mistercheph
154 days ago
|
|
I think the recently introduced -fit option which is on by default means it's no longer necesary to -ngl, can also probably drop -c which is "0" by default and reads metadata from the gguf to get the model's advertised context size |
|