[bunderbunder]

I doubt you'll get that, because nobody thinks that progress in machine learning will stop.

An AI winter doesn't mean that progress stops. It means that businesses and the general public become disillusioned by AI's or ML's failure to live up to the popular hype, and stop throwing so much money at it. The hype then dies down. Research continues, though, until enough progress is made that machine learning starts to produce results that excite the public again, and the cycle goes into another hype phase.

[RushAndAPush]

> I doubt you'll get that, because nobody thinks that progress in machine learning will stop.

Robin Hansen is notoriously skeptical about the possibility that Deep Learning can make real gains. He for some reason thinks brain emulation is more likely to make large progress in AI.

>An AI winter doesn't mean that progress stops.

It doesn't completely stop, but progress would be at a snails pace.

> The hype then dies down. Research continues, though, until enough progress is made that machine learning starts to produce results that excite the public again, and the cycle goes into another hype phase.

I think we as a community may need to take a good long look at the hype cycle theory and be skeptical it has any merit.

[bunderbunder]

I don't know that I'm positing any sort of formal theory, just describing a pattern that's been going on for decades now. I'd suggest that unless something fundamental changes, there's a reasonable chance that it will keep on going that way.

Progress in machine learning has never been at a snails pace. What has happened at times is that the futurists of the world stop making breathless pronouncements about machine learning, and that creates a public perception that things are going slowly.

Case in point: Deep learning really isn't anything revolutionary or new. I first started noticing papers about stuff that now falls under the "deep learning" catchphrase about 15 years ago. Not because it started then, but because that's when I started reading that sort of thing. During that time, there's been relatively constant, steady progress being made. But you wouldn't know it unless you had been following the literature, which not many people do. And all of this happened at a time when everyone was convinced that neural nets were dead and support vector machines were the way of the future.

As far as Robin Hansen's skepticism about deep learning getting us to true artificial intelligence, meh. A technology doesn't need to make Ray Kurzweil's eyes roll back in his head for it to be useful.

[dwaltrip]

Brain emulation? I didn't realize people seriously thought that could be good for anything other than research and investigation.

If we can successfully emulate the brain, it seems we would have necessarily acquired the knowledge needed to build models that are very powerful without having to exactly mimic the brain.

[Jach]

See Hanson's http://ageofem.com/

[dwaltrip]

I keep hearing great things about that book. Thanks for the link, maybe it is time to pick up a copy.

[tannhaeuser]

Sorry but I don't think "AI winter" as a term is appropriate here.

The "AI winter" as I know it was around 1988. I've still vintage issues of "AI Expert" and other publications of the time (which I kept for their great linocut-style artwork, and because they were expensive items here around).

Back then it wasn't so much about ML (aka "Deep Learning") but anything Prolog, expert systems, artificial neural nets and their generalizations, and Lisp.

[goatlover]

Why, as presumably rational agents, is there so much hype with certain technologies, even though past history should have taught us otherwise? Is it all for the VC? Is it the media just needing to sell stories? Usually there are smart, knowledgeable people involved in the hyping. They should know better.

[BeingIncubated]

There is no such thing as complete rational people, every person goes through bouts of rationality and irrationality, some are just more often rational than others. With that said nobody is immune from irrational emotion sometimes, for example have you been angry from something that wasn't worth it?

[goatlover]

Hell yeah I have been. And then realized it was stupid later.

[walrus1066]

Participating in hype may be very rational.

Putting 'AI' on a startups prospectus will do it no harm. It may help sway lazy investors, or at least make the company appear more cutting edge.

Same goes for the investors, they want to be seen to be investing in cutting edge, buzzword compliant startups.

It is just human nature, following the herd is always going to be the safest option.