|
|
|
|
|
|
by melvinmt
1673 days ago
|
|
|
Let's take this example: https://beta.openai.com/examples/default-factual-answering 95% of the token usage in this example would consist of the prompt and I would only get 1 sentence in return. So if I wanted to generate another sentence, I would have to pay 95% of the cost towards the prompt again and again... Isn't there a way to create a template for the prompt so you only pay for the generated sentences? |
|
|