I had a shock when I looked up prices for H100 gpus, wanting to use one just for personal experimentation and for an upcoming hackathon. How much this one costs? $300,000?
To elaborate: you can't really buy these except in specific configurations from Supermicro (usually 8x H100) or the like. So take whatever chip-specific cost you have in mind, and 8x it, and add on the cost of CPU/memory/storage. NVIDIA doesn't bother to sell these in a configuration that you can plug into your desktop.
If you want a consumer GPU, you can go for the RTX 4090 (24GB VRAM) or the A6000 Ada (48GB VRAM) if you are building a workstation.
If you really need to "experiment" on an A/H100, then you can rent it by the hour through a cloud provider like Runpod.