Hacker News new | ask | show | jobs
by mirekrusin 1213 days ago
Do you have to prefix every user query with a long list of examples to create context (and be billed for it extra for every query)?

Or there is a way to create context with some prelude and then use it for subsequent queries?

Let's say I want to create quick help for SQL, where the prelude would be schema snapshot and some examples.

Do I need to flood every user query with this long prefix of sql schema snapshot with examples?

I don't want one user conversatio to interfere with other user query.

1 comments

no fine tuning for gpt-3.5-turbo
I think they’re planning to release fine tuning for gpt3.5 later but the only way to avoid a long prompt at start is fine tuning