Hacker News new | ask | show | jobs
by dekhn 1177 days ago
I'm using the first model on the SAM website ( ViT-H SAM).

It's definitely using the GPU- I'm running nvidia-smi and I see near 100% utilization on the GPU while the CPU is using 1 core. If I run the script with --device=cpu then I see my server using 4 cpu cores and no GPU and it takes tens o seconds per image.

I'm trying to check with people who have experience with this specific model.