We have two mechanisms whereby we retain data. Both are opt-in and off by default.
One mechanism where you get a discount and we can use the data (in theory this does mean sell it; but our intent is to use it to make efficient dynamic routing solutions. But absolutely we could one day sell it) and another where we retain it for you so you can see it in your logs. We have no rights to this data in any way. This is similar to how any tracing/logging solution works.
Both and opt-in. If you don’t opt in, we don’t retain anything and are a pass through with regards to your prompt data.
All of this is carefully documented and I encourage you to explore and chat with the docs.
Do you specify prompt data, because prompt data is subject to user copyright, but LLM outputs are not? There is the issue that LLM outputs might leak user data back through the response. Y'all don't log those either, correct?