|
|
|
|
|
|
by phillipcarter
1050 days ago
|
|
|
FWIW, OpenAI's availability seems to have gotten significantly better since May when we launched with them. I monitor our availability Service Level Objective and we keep needing to increase the success rate because they keep improving things. This doesn't take away from high availability being a legitimate need to host your own LLM, though. |
|
|