Hacker News new | ask | show | jobs
by callistus 1171 days ago
> his A100 GPU (a $10,000 GPU)

These are available to rent per hour at much lower costs. The author mentions this in the video description.

2 comments

True, as much as I enjoy owning and controlling my own hardware, buying an A100 and then letting it sit idle while I procrastinate and play video games probably isn't the best use of resources. He did say "my GPU" (or similar) at one point, and I thought maybe he does enough ML stuff that he bought his own.
If you have an NVIDIA gaming GPU you can train reasonable transformers.
Approximately 40 cents USD for 15 minutes from cursory research.
I'm completely unfamiliar with this market. Do you rent these on AWS? Or where?
https://jarvislabs.ai/pricing/

$1.29 per hour for a 40gb a100 apparently

https://lambdalabs.com/service/gpu-cloud#pricing

$1.10 per hour

If you're ok with 24GB you can use a 3090 https://www.genesiscloud.com/pricing for 0.70$/h