[benreesman]

I also consume all the heavily sibsidized LLM tokens I can find a use for. Great deal for us, the people who funded it?

Not so fun.

[torginus]

LLMs also cost what they cost because NVIDIA won't sell you a 5090 upgraded with 80GB RAM for $3000 instead of $2000 (which is overkill in the first place). Yo have to buy a H200 for $40000

[m4rtink]

If there is demand, someone will sell that eventually - while NVIDIA has a headstart, they "just" fab stuff on TSMC anyway. AMD and to a degree Intel are already starting to sell cards with more VRAM.

[Henchman21]

Apparently you can get these on the black market in China, at least according to “Gamers Nexus”

https://m.youtube.com/watch?v=1H3xQaf7BFI