[teaearlgraycold]

Which while expensive is dirt cheap compared to a comparable NVidia or AMD system.

[SchemaLoad]

It's still very expensive compared to using the hosted models which are currently massively subsidised. Have to wonder what the fair market price for these hosted models will be after the free money dries up.

[whatsupdog]

I wonder if the "distributed AI computing" touted by some of the new crypto projects [0] works and is relatively cheaper.

0. https://www.daifi.ai/

[cactusplant7374]

Inference is profitable. Maybe we hit a limit and we don't need as many expensive training runs in the future.

[paxys]

Inference APIs are probably profitable, but I doubt the $20-$100 monthly plans are.

[cactusplant7374]

I wouldn’t be so sure. Most users aren’t going to use up their quota every week.

[teaearlgraycold]

For sure Claude Code isn’t profitable

[bdangubic]

Neither was Uber and … and …

[plagiarist]

Businesses will desire me for my insomnia once Anthropics starts charging congestion pricing.

[bdangubic]

that is coming for sure to replace the "500" errors

[blharr]

What speed are you getting at that level of hardware though?