Hacker News new | ask | show | jobs
Llama3 Performance Cost Benchmark (parseur.com)
2 points by joss82 788 days ago
1 comments

I spent the last few days testing Llama3 on different GPUs, to find the cheapest cost per token. Spoiler: it's the Nvidia L4, surprisingly.