Hacker News new | ask | show | jobs
by BaseballPhysics 1210 days ago
> Even if GPT somehow doesn't impress you currently, why do you think things won't be improved in 6 months? What about 5-10 years from now?

Need I remind you of the AI winter?

Progress isn't linear. You want to believe progress will continue at its current pace. I'd suggest it's every bit as reasonable to assume progress will stall out as current techniques plateau, just as they did in the past.

2 comments

Everything ends, it's true.

But there's no reason to believe that this technique will plateau before some noteworthy results are obtained.

Other than being connected by the term 'AI' what makes you believe that the past performance of researchers is indicative of future performance?

Are any of the limitations of the Apollo program inherent limitations of space exploration? How are they connected?

> But there's no reason to believe that this technique will plateau before some noteworthy results are obtained.

Absolutely there is, and the article specifically touches on it.

Because these models do not encode semantics, there's very little reason to believe the hallucination problem can be solved with current techniques.

In fact, OpenAI themselves have been downplaying expectations about GPT-4, and my suspicion is that's because these techniques are already starting to plateau.

I fully expect that GPT-4 will create even more natural-seeming language, with greater sentence variation, less repetition, etc, and with no change (or possibly even an increase) in the frequency of factual errors in the results.

We will literally never go into another AI winter. The results and earnings from AI are too good to put the cat back in the bag.
LOL, I suspect a lot of crypto bros were saying the same thing a couple of years ago.

Let alone other hyped technologies that have failed to deliver, like self-driving cars, voice assistants, AR/VR...

Heck, the AI winter was preceded by a boom in things like expert systems, and I'll bet folks back then thought it'd never end, too.

The fact that you'd lump Crypto and AI together is simply pathetic. Crypto still hasn't actually solved any real problems or delivered meaningful value. AI has solved real problems and delivers astronomical value.

I'm willing to put my money where my mouth is. I'm willing to enter into a $$$ wager and assert that AI, specifically LLMs or similar systems, will only become more important and more in demand in 5 years.

I wasn't the one using "dollars pumped into the bubble" as a predictor for likely future success. If you don't like the comparison, come up with a better argument.