[brucethemoose2]

But is this going to blow over in a few days? Again?

I can certainly appreciate frustration with the AMD stack, but be blunt, I was not impressed with Hotz's YouTube rant from before.[1] It didn't give the impression of a stable framework, and this doesn't either.

Also (at least from the end user llm inference side of things) ROCm is not nearly as unusable as it used to be. We would certainly be renting MI300s over A100s (or even H100s) if we could get any, and we use a number of different inference backends.

1: https://news.ycombinator.com/item?id=36193625

[whalesalad]

he's always been nails on a chalkboard for me. rant, whine, cry, repeat. reminds me of larry david with a CS degree.

[brucethemoose2]

I never followed Hotz, so perhaps I missed something cool. But I never understood the hype myself.

[jauntywundrkind]

The post PC era of big expensive hardware you can't even buy if you do have the money is upon us, and mercy this is a scary scary time in computing for me/us.

[brucethemoose2]

I was talking about renting!

There are some boutique hosts like Hot Aisle serving MI300s (who I really should reach out to), but for the immediate future our little startup is stuck with the big cloud providers. No MI300s for us mere mortals, not even to rent.

[smoldesu]

Besides the datacenter stuff, what exactly are people struggling to source these days? The 30/40-series prices should be fairly stable relative to the MSRP these days.

[brucethemoose2]

Used 3090 prices are absolutely outrageous.

And the 4090 MSRP was outrageous to begin with.

[pjmlp]

Yet another thing to go back to 1990's ecosystem. We already have timesharing again, now we have the prices as well.