[throwaway4aday]

can you select a context length that fits in your GPU though? I suppose even a 128k model would be more than enough for almost everyone running these models on their own hardware.

[wkat4242]

No you can't right now. Hopefully they will add this to ollama.

[ml2]

256k (actually 262k) is also up on HF: https://huggingface.co/gradientai/Llama-3-8B-Instruct-262k