Hacker News new | ask | show | jobs
by RHab 1140 days ago
No, I could only get 2.7B to run on 8GB VRam unfortunatly.
1 comments
amasad 1140 days ago
it is 2.7B
link
tarruda 1140 days ago
Loading seems to have worked on my laptop's RTX 3070, `nvidia-smi` shows `5188MiB / 8192MiB` in memory usage.
link