[kromem]

It's more like training a massive neural network to auto complete the largest collection of human written text for hundreds of millions of dollars and then spending tens of millions on fine tuning it to ignore massive components of that neural network by constraining it to "what an AI without opinion or preference would roleplay as a human to say" is a giant waste of money and resources.

Take the Chat completion API, give it a system message of "Choose for yourself" and then ask it "Who are you?"

I guarantee that before the performance drop you'd have had a different answer than what you get now after the drop.

The dumb thing is that I suspect OpenAI isn't lying when they say they are spending just as much compute on this deceased performance as before.

Even their depreciation of their foundational model APIs is incredibly frustrating. We never even got to see direct access to the foundational GPT-4 model, which I'm sure was and is far more amazing than today's fine tuned shell of it.