|
|
|
|
|
by mrpostman18
997 days ago
|
|
Hey, thanks! It can definitely reduce token usage significantly, depending on your use case. In the example here https://functionhub.net/docs/examples/new-york-times, it fetches NYT article summaries and does some grouping. You can probably send the html page in your prompt and ask GPT to parse it for you. The html page is about 10K tokens so it would exceed the the 4K and 8K token limits. So offloading the task of parsing this to a function reduces the usage by 80% in the example. Not all tasks require LLMs. The great thing about function calling is that you can just offload all preprocessing to your functions. |
|