[esmy]

The last time I remember this happening, the shovel-making machines lost a lot of value and got amortised out to the second hand market. When the prevailing coin still mined on GPUs switched algorithms the bottom of GPU prices fell out on eBay.

I expect at some point a) the training and the inference will move to even more specialised hardware and the current existing silicon go to either hobbyists or some other market that requires the current cards b) the way in which we do AI may fundamentally change in ways we can't predict, causing the required hardware to also change (move to FPGA or favouring some other aspect than VRAM)

In both scenarios NVIDIA isn't the one who win, because the sudden influx lifts a secondary market nv don't profit from directly.

I personally don't think they'll be able to sustain their current valuation past the current AI rush, and will compact back down to somewhere their levels pre-chatgpt.

That said I'm just a guy on the Internet who wouldn't mind some beefy ex-datacentre gear if I could make it work for video editing workloads.

[pbronez]

Heh I am so ready to put an A100 in my homelab. Gonna take some intelligent power management though…

[xattt]

Have you considered running busbars from your closest pole transformer?

[pbronez]

haha no fire hazards there!

The official specs [0] say the A100 80GB has a 300W TDP. That's pretty doable on standard domestic power... harder if you want to run multiples.

[0] https://www.nvidia.com/content/dam/en-zz/Solutions/Data-Cent...

[Gracana]

Same here. My eBay watchlist always has a few in it, but the prices just aren't where I need them to be. For now I am focused on inference with a dual 3090 rig, and my next step will be to fit another pair of 3090s, which is the max I can easily support with my AM5 motherboard. What's slowing me down is the fact that I can't run server hardware due to noise, and I can't run an open-air setup because my cats would get into it, so I need to buy or build a case to hold everything.

[pbronez]

Dug into A100 sale prices using Ebay's Terapeak analytics. I found several recent sales for $2000 or less:

https://www.ebay.com/itm/335392812272?nordt=true

https://www.ebay.com/itm/335408349837?nordt=true

https://www.ebay.com/itm/335414821299?nordt=true

Too good to be true? Perhaps. For $2000 I might trust Ebay's buyer protections...

[Gracana]

Wow! Yeah, I would have taken a shot at that. The seller seems legitimate, judging by their other listings.