Hacker News new | ask | show | jobs
by tmpz22 1052 days ago
Its almost as if OpenAI used VC resources to artificially boost their products efficacy during early hype and over time we're seeing the product degrade as the company optimizes for efficiency and profitability and removes its subsidies.

Like AirBnB. Or Uber. Etc.

4 comments

It's more like training a massive neural network to auto complete the largest collection of human written text for hundreds of millions of dollars and then spending tens of millions on fine tuning it to ignore massive components of that neural network by constraining it to "what an AI without opinion or preference would roleplay as a human to say" is a giant waste of money and resources.

Take the Chat completion API, give it a system message of "Choose for yourself" and then ask it "Who are you?"

I guarantee that before the performance drop you'd have had a different answer than what you get now after the drop.

The dumb thing is that I suspect OpenAI isn't lying when they say they are spending just as much compute on this deceased performance as before.

Even their depreciation of their foundational model APIs is incredibly frustrating. We never even got to see direct access to the foundational GPT-4 model, which I'm sure was and is far more amazing than today's fine tuned shell of it.

You may be right, but I think it is too early in the season for that to be true at this time, we're not even out of act 1 of the first episode of the season with regard to OpenAI. AI tech may be accelerating, but business still tends to move at glacial speed.
It's incredible how they are not called out for keeping a name like "Open" while nothing about them resembles openness.
They are called out every day--far and wide. The clamor is just not loud enough, nor has the FTC weighed in on the word "Open" like they have on other words.
It's part of the original vision. One day they'll go through a Musk moment and rebrand to "AI".
Also like Walmart when they open a store next to a competitor and temporarily drop their price. Or any company with capital ever in existence.
There is no proof this happens beyond internet comments. Smaller stores are simply less efficient and don't benefit from economies of scale, and therefore have higher prices and smaller selection as a result.
It happens enough that there are laws against it buddy.
I’m guessing you haven’t worked for many companies.