Hacker News new | ask | show | jobs
by sometimelurker 25 days ago
> AI psychosis

I think most of us have an acute sort of it

> next token predictor model

(nondeterministic) next token predictor = capable of outputing any text

if MLPs optimize over the space of functions, and sequence to sequence models (RNNs, transformers ect) optimize over the space of programs/algorithms, what exactly is left to figure out to make a machine that can do anything? their bet is nothing, that all we need is a very complex algorithm that can found with SDG/AI training. I think its obvious such an algorithm exists, and I think SDG can probably find it.

here's an interesting take i heard (from vladimir_Nesov): LLM technological progress is logarithmic, but the resources being put into them are exponential.

all this can be made smarter (-than human) just by making it larger