[lukewarm707]

it is better for security when code is simple.

i tried using litellm and it was 700mb! it does have a lot of features. postgres db, prometheus, api layer. really complicated. but simple help is missing. it assumes you will put passwords in an env file. how do you add chat completions in the ui? how do you add a custom provider?

but, what i wanted, a simple proxy, can be written in 30 lines of python in fastapi. memory fetch/push in 50 lines. different providers can be added with two lines, one import and one client create.