Y Hacker News new | ask | show | jobs

user: chaoyu created: 2014-11-01 karma: 32 Twitter @chaoyu_ submissions: Benchmarking LLM Inference Back Ends: VLLM, LMDeploy, MLC-LLM, TensorRT-LLM, TGI 15 points | 1 comments 0 points | 0 comments 0 points | 0 comments 0 points | 0 comments 0 points | 0 comments 0 points | 0 comments 0 points | 0 comments 0 points | 0 comments 0 points | 0 comments 0 points | 0 comments 0 points | 0 comments Show HN: ML Serving orchestration framework on Kubernetes 2 points | 0 comments 0 points | 0 comments 0 points | 0 comments BentoML: The easiest way to build Machine Learning APIs 4 points | 1 comments 0 points | 0 comments 0 points | 0 comments 0 points | 0 comments 0 points | 0 comments 0 points | 0 comments 0 points | 0 comments 0 points | 0 comments Vote with Your Feet: SF Art Installation 1 points | 0 comments