[transitivebs]

Here's another open source alternative: https://github.com/6/openai-caching-proxy-worker

[transitivebs]

Aaand another even simpler one: https://github.com/egoist/openai-proxy

This one uses Reflare under the hood: https://github.com/xiaoyang-sde/reflare

[justintorre75]

These are great! we looked into using reflare as well, however reflare does not support streaming at the moment. We are looking to give back to the community and add it for them.

I opened this issue up last week https://github.com/xiaoyang-sde/reflare/issues/443

[xasiimov]

It appears that the author has responded to the issue, but you haven't replied yet.

[mdaniel]

Wow, I had no idea GH allowed single character usernames; GL as well https://gitlab.com/0