|
|
|
|
|
|
by zozbot234
107 days ago
|
|
|
If you have good performance storage, you don't need to keep all your params in VRAM. The big datacenter-scale providers do it for peak performance/throughput, but locally you're better off (at least for the largest models) letting them sit on storage and accessing them on demand. |
|
|