Hacker News new | ask | show | jobs
by davidfiala 653 days ago
- 1,800tps on llama 3.1 8B

- 450tps on llama 3.1 70B

free chat interface is at: https://inference.cerebras.ai (requires login)