Hacker News new | ask | show | jobs
by ZetsuBouKyo 31 days ago
I am relatively pessimistic about the profitability of those panning for gold in the downstream AI market.

The core bottlenecks are power and computing capacity, and they actually trace back to the exact same issue. It all comes down to the physical energy it takes to flip or move a single bit inside the ram or disk storage. This concept is subject to fundamental physical barriers.

There are a few ways to tackle this, like improving power efficiency, reducing model size, or pushing hardware further. However, achieving orders-of-magnitude improvement in any of these areas will cost a massive amount of time and money. I wonder if governments, corporations, and investors have the patience to wait for these tech breakthroughs.