|
|
|
|
|
|
by tmaly
1037 days ago
|
|
|
What is the average paragraph length? I would consider using one of the 32k context windows. Define a delimiter for the paragraphs and prefix the prompt to process each then write out with a delimiter the result you need. Maybe wrap your call in a simple try catch and do exponential back-off. |
|
|