Hacker News new | ask | show | jobs
by egorfine 712 days ago
Play around with temperature. Summarization is quite a defined task, so lower the temp a lot.
1 comments

It's not just that. Following instructions, text generation, etc. all seem to be worse with the api version. At least, when it comes to 3.5 - 4o is much better. Ironically, 4o had problems with correct json output where 3.5 hadn't. It produced ```json {...}``` instead of just the json object.