Hacker News new | ask | show | jobs
by dexterlagan 311 days ago
I have a similar setup but with 32 GB of RAM. Do you partly offload the model to RAM? Do you use LMStudio or other to achieve this? Thanks!
1 comments
SirMaster 301 days ago
Yes, LMStudio and it automatically does this.
link