|
>there is a relationship between information theory and thermodynamics, and nobody, including no superintelligence, will be able to break it. The way the lesswrong people could know or not, to "break" through information theory and thermodynamic constrains is the known one to work, the way humans are using since the 70s. Algorithm improvements, leading to better hardware, leading to new algorithm improvements, leading to better hardware. Along the way we got ASML machines, tensors, stuff keep coming regularly. A very low percentual improvement in current algorithms, given the scale of current AIs infrastructures, lead to improvements, even radical improvements. https://research.google/blog/distilling-step-by-step-outperf... LLMs got thrown into the mix recently, and now we have something like better hardware > better LLMs > better algorithms > better hardware. i.e. Many recent (I'd insist here with "radical", but very, very small improvements have a magnified effect, so they are really important too), improvements could potentially be already the outcome from a LLM, or the collaboration between LLM and humans. There were attemps to register patents for "AI discoveries" (denied), maybe those were examples. So, ASI is not yet proved constrained by information theory nor thermodynamics, having not reached yet any "wall". It potentially could exist ASI well within the constrains of suchs variables. |