Hacker News new | ask | show | jobs
by sothatsit 318 days ago
In fact, proxy servers like LiteLLM[1] already exist that are very easy to setup and set limits in.

[1] LiteLLM: https://www.litellm.ai/