Hacker News new | ask | show | jobs
by acchow 541 days ago
> ~doubling every 2-2.5 years) puts us at 20~25 years.

The trend for power consumption of compute (Megaflops per watt) has generally tracked with Koomey’s law for a doubling every 1.57 years

Then you also have model performance improving with compression. For example, Llama 3.1’s 8B outperforming the original Llama 65B

1 comments

Then you will just have the issue of supplying enough of power to support this "linear" growth of yours.