Hacker News new | ask | show | jobs
by charcircuit 359 days ago
The is no guarantee when it will be garbage collected. For large local models that use a lot of resources they should be unloaded as soon as possible to allow other programs on the computer to use the resources.