Hacker News new | ask | show | jobs
by robbiet480 11 days ago
Did you look at LiteLLM at all? It seems fine but Bifrost looks interesting too.
2 comments

Yeah I looked at it, LiteLLM is functionally more mature.

The only reason I didn't go for it is I'm not a fan of Python dependency management, Bifrost is just a single executable that uses nearly no memory and is lightning fast.

LiteLLM is bad. Shit performance, buggy, and none of it surprising if you look at the tangled mess that is their codebase.