Hacker News new | ask | show | jobs
by cheptsov 620 days ago
Unfortunately, neither VLLM nor TGI support FP8 on AMD yet. But once they do, we will look into it.