|
|
|
|
|
|
by krishadi
1131 days ago
|
|
|
They are not all computationally expensive. The rate limiting step here is the LLM call itself over the API. So, async is definitely needed. The other aspects would be loading the template from filesystem. I would assume this could be something that's needs to be optimized in the application. |
|
|