Hacker News new | ask | show | jobs
by sReinwald 473 days ago
You can also set

    OLLAMA_CONTEXT_LENGTH=<tokens>
as an environment variable to change ollama's default context length.
2 comments

I think that will not work if you use the OpenAI compatible API endpoint.
I tried this with ollama run, and it had no effect at all.
that env parameter is brand new, did you update ollama?