Hacker News new | ask | show | jobs
by pzo 798 days ago
deepseek-coder-instruct 6.7B still looks like is better than llama 3 8B on HumanEval [0], and deepseek-coder-instruct 33B still within reach to run on 32 GB Macbook M2 Max - Lamma 3 70B on the other hand will be hard to run locally unless you really have 128GB ram or more. But we will see in the following days how it performs in real life.

[0] https://github.com/deepseek-ai/deepseek-coder?tab=readme-ov-...

1 comments

With quantized models you can run 70B models on 64GB RAM comfortably.