Hacker News new | ask | show | jobs
by mike10921 873 days ago
On the flip side, I find that GPT4 is constantly getting degraded. It intentionally only returns partial answers even when I direct it specifically not to do so. My guess is, that they are trying to save on CPU consumption by generating shorter responses.
3 comments

I think at high traffic times it gets slightly different parameters that make it more likely to do that. I've had the best results during what I think are off-peak hours.
My feeling is that it got worse but then it got better again over the last few months. I don't have data to back this of course.
Is this with the API or web interface?