Hacker News new | ask | show | jobs
by ftxbro 1121 days ago
What does this mean for the AI race? For example what if a newish company (newer than Google/Facebook/Microsoft/etc.) like Anthropic, Scale, Perplexity, or Stability is able to scrape together $5B USD funding and spend their hardware budget on these things. Say that can buy $1B of them and spend the rest on hackers and operating expenses (idk if that's realistic). So maybe they could purchase and operate like 20 of them. Say that they spend six months doing experimental things and then the next six months training their Tsar Model. If they follow the Chinchilla scaling laws and normal architectures, how good will these models be?
2 comments

For AI race means it opens the door to a competitor. Could be AMD, Google, or Amazon. All which have offerings in this space.

However while the hardware isn’t cheap, it’s still likely not a blocker. Costs do inhibitor more experimental research.

Startup which will rent this compute when needed will likely have more advantage on AI front.

Selling shovels is good business, but doesn't compete directly in AI area.