Hacker News new | ask | show | jobs
by RobotToaster 33 days ago
Any idea what kind of vram is needed to run this on Nvidia?
3 comments

It runs natively on the Photos app in Vision Pro, which shares 16GB of ram with GPU and CPU.
The Python process peaks at about 15 GB, so maybe a 24 GB GPU works. But others seem to have problems wih Nvidia: https://github.com/apple/ml-sharp/issues/84
The smallest Nvidia gpu I've run Sharp on is an Nvidia T4 which I think has 16 GB on the chip