Hacker News new | ask | show | jobs
by adastra22 148 days ago
What’s the best open source alternative?
3 comments
jckahn 148 days ago
Jan: https://www.jan.ai/
link
PeterStuer 148 days ago
LibreChat with vLLM?

https://www.librechat.ai/docs/configuration/librechat_yaml/a...

link
khimaros 148 days ago
llama.cpp
link
atwrk 148 days ago
To add a few more details: llama.ccp now both has a web ui out of the box that even supports model switching, and easy model file downloads from huggingface using the cli: '-hf name_of_model:the_quant_you_want'.
link