Hacker News new | ask | show | jobs
by magundu 1060 days ago
It is really amazing.

With this command “ollama run llama2”, I can run llama2 instantly.

Do you know how much RAM and disk space needed to run this llama2 model?

2 comments

For disk size, you can see how big models are locally by running "ollama list"

  NAME          SIZE   MODIFIED      
  llama2:latest 3.8 GB 3 hours ago
Now, if you make new models that are "FROM llama2" for example, Ollama will re-use this "base model" so you don't store it twice.
By default the `llama2` model is the 7B model, and it's recommended you have at least 16GB of memory to run it.

Regarding the disk space, the model itself is 3.8GB.