[ben_w]

If the OpenAI pricing is indicative, reading 16k token of medical history and giving a 4k token response will cost $1.50 on GPT-4 and 6.4¢ on GPT-3.5-turbo.

The lower of those two is roughly what someone at the UN abject poverty threshold will spend in 48 minutes 30 seconds on "not literally starving to death".

[tim333]

>spend in 48 minutes 30 seconds on "not literally starving to death".

I don't get that. In the poorest people get by on the equivalent of about $1 per day and not many starve. In fact the only part of the planet where the population is booming at the moment is sub Saharan Africa.

Chat GTP and similar will presumably have free tiers.

[danielbln]

And if you use fine tuning and RAG you can cut the cost by an order of magnitude. Also, how much did it cost 2 years ago?

[ben_w]

Was it[0] available at any price 2 years ago?

(Assuming you mean literally an order of magnitude: 0.64¢ is, judging by Amazon.com, less than the bulk price of a single sheet of unused printer paper, or two thirds of a paperclip).

[0] 3 or anything equivalent to it, given 4 obviously wasn't

[danielbln]

I was making the point that this is new tech, not available to us at all a few mere years ago, so assuming a constant cost when making predictions is difficult. Assume inference prices will go down, not up.

[ben_w]

Ah, in that case we're on the same page. I'm expecting at least a factor of 1000 to be possible given the apparent higher efficiency of the human brain vs current computers, which is of course terrifying given how good and cheap the various creative AI already are, while also seeming like a prerequisite for robotic/car AI to be all three of "good enough", "fast enough", and "within the limited power budget".