Hacker News new | ask | show | jobs
by sfifs 34 days ago
Very nice! I also saw you have a vllm branch and I validated it works on my system. There is bugfix which sent you a PR for to auto-discover served-model-name which vllm hard validates for.
2 comments
zambelli 33 days ago
Merged! Thanks for that catch. I'll try to sequence the in-flight work ASAP to get the vllm branch merged in as a whole.
link
zambelli 34 days ago
Oh, awesome! I'll take a look.
link