Hacker News new | ask | show | jobs
by gandutraveler 907 days ago
Can someone explain th hardware differences for training vs inference? I believe Nvidia is still the leader in training?
1 comments

Yup, graphics processors are still the best for training. Groq's language processors (LPUs) are the state of the art for inference, far faster than any competitors. We have an open challenge to our competitors: can you match our inference tokens per second?