Hacker News new | ask | show | jobs
by zamadatix 476 days ago
I always see:

  /set parameter num_ctx <value>
Explained but never the follow up:

  /save <custom-name>
So you don't have to do the parameter change every load. Is there a better way or is it kind of like setting num_ctx in that "you're just supposed to know"?
1 comments

You can also set

    OLLAMA_CONTEXT_LENGTH=<tokens>
as an environment variable to change ollama's default context length.
I think that will not work if you use the OpenAI compatible API endpoint.
I tried this with ollama run, and it had no effect at all.
that env parameter is brand new, did you update ollama?