|
|
|
|
|
|
by devdiary
795 days ago
|
|
|
> at the end of the day prompts are just a API call and it's easier to write standard code that treats LLM calls as a flaky API call They are also dull (higher latency for same resources) APIs if you're self-hosting LLM. Special attention needed to plan the capacity. |
|
|