Hacker News new | ask | show | jobs
by djangelic 1040 days ago
I see it differently. They built the best they could, but it was expensive. Now it feels to me that they are "optimizing" it for performance by seeing if they can lower the quality but still give people just enough value to pay for it. Makes me think they are trying to find a sweet spot between performance and cost. I am seeing this drop in quality, but mostly when it comes to the model remembering things you've told it in the past, and a much bigger dependence on custom instructions for prompts.

I still get value, but I have to give it the documentation I want it to focus on during the prompt, instead of referencing it earlier in the conversation.

This makes me think they are lowering it's ability to store context so that the calls don't cost as much to make.