Hacker News new | ask | show | jobs
by SAI_Peregrinus 308 days ago
Nature abhors an exponential. They all seem to either turn out to be sigmoid or collapse entirely.
1 comments

Well...everything has a limit, so yes every example of exponential growth gets capped somewhere and becomes a sigmoid. Viral spread, population growth, radioactive decay, tree branching, etc. are all exponential until they hit their limit. Otherwise each process would quickly proceed to infinity. That doesn't really tell us much about where the ceiling is for LLMs, however.