Hacker News new | ask | show | jobs
Nvidia Releases TensorRT-LLM (github.com)
2 points by hkab 976 days ago
1 comments
hkab 976 days ago
Performance: https://github.com/NVIDIA/TensorRT-LLM/blob/release/0.5.0/do...
link