Hacker News new | ask | show | jobs
by zozbot234 39 days ago
96GB is what the author claims will work in a foolproof way for easy production use. But nothing stops you from trying to run it on 48GB, it ought to gracefully fall back on accessing model layers from the disk.