[scrawl]

"he's gonna milk it to every drop" is such an odd take.

eliezer has long been concerned about AI and the risks it poses to humanity. and for just as long people have called him crazy and made hand-waving arguments for why we shouldn't be concerned.

now we're in the midst of an AI arms race and we don't have any good idea how this tech works. it progresses at a truly astonishing rate, where it's become sport to find instances of people saying "AI will never be capable of X" and showing them the latest AI doing X with ease.

i think his concern is real and justified. you might disagree, but i don't understand why think he's milking recent developments.

[happymellon]

> It's become sport to find instances of people saying "AI will never be capable of X" and showing them the latest AI doing X with ease.

Interesting, I've not seen that many educated in technology make that claim that it will never, just that people are surprised that the folks leading this, Microsoft and Google, have a track record of turning their consumer facing products to advertised junk.

[solarmist]

I've seen plenty of people making nearly those claims. Barely qualifying things with phrases like "not in my life."

Especially in the arts. Granted, that's dropped dramatically over the last decade since ML started taking off.

[qorrect]

> we don't have any good idea how this tech works.

Do you mean the specifics of GPT-4, or Transformers in general ?

[famouswaffles]

he's likely talking bout the internals. sure we know how to train them but nobody knows what the models learn exactly. how those billions of parameters shape the output on inference.

a few months ago, just this year some researchers discovered what might be the neuron that largely decides when to use an in gpt-2. yes 2. that's what he means.

https://clementneo.com/posts/2023/02/11/we-found-an-neuron

[MacsHeadroom]

Presumably he means all types of machine learning in general.