Hacker News new | ask | show | jobs
by ddren 1194 days ago
The (quantized) 13B model is 7.6 GB on disk and the program uses around 8 GB to run. It runs without hitting the swap with just 9 GB assigned to WSL2.