Y
Hacker News
new
|
ask
|
show
|
jobs
by
Terretta
760 days ago
Macbook Pro with 128GB RAM runs Llama 3 70B entirely in memory and on GPU. It's remarkable to have a performant LLM that smart and that fast on a (pro)sumer laptop.