[LordHeini]

I think, the cost of running and training models is going to fall due to Moore's law and friends.

That also meas that the worth of today's computers declines rapidly and all the money invested in compute power with it.

Compute is basically what the AI VC money is spend on. That money will be gone in a few years due to the hardware being worthless.

On the other side running a model (locally) will become cheaper and cheaper to the point that Ai stuff becomes a everyday commodity running on cheapo devices everywhere.

Then there are optimizations too. Which lowers the cost.

So it's not going away and it's not going to be expensive for the consumer in the long run.

My 5 year old rtx 2027 runs models those output would have been state of the art a couple of years ago. In a few years something running on the level of today's top models might run under your desk if that progress goes on at this pace.

[orderone_ai]

Don't those have like 8GB of VRAM? Ain't no way you're running something that produces GPT-4 like results on that.

[ratrace]

Moore's law isn't a law anymore and hasn't been for a long time. CPU speeds are stagnant.