Hacker News new | ask | show | jobs
by wmf 556 days ago
Yes, Groq requires hundreds or thousands of chips to load an LLM because they didn't predict that LLMs would get as big as they are. The second generation chip can't come soon enough for them.