[giancarlostoro]

It matters when you want a correct answer and if it has no way to confirm correctness then you have a problem. The famous goof from chatgpt that I bring up: someone asked chatgpt what the differences were between cow eggs and chicken eggs, instead of answering based on knowledge, it listed out plausible differences based on what it knew about a cow minus the fact cows dont lay eggs.

[xianshou]

GPT-4 gets this one now, just as it does the "diamond in a teacup" question. I asked about "pig eggs" instead of "cow eggs" in case it had memorized a public post about cow eggs.

---

Pig eggs and chicken eggs differ fundamentally, as pig eggs are not laid by pigs, while chicken eggs are laid by chickens. Let's clarify the differences:

Chicken eggs: These eggs are laid by female chickens (hens) and are a common food source for humans. They have a hard, calcium-based shell and contain the yolk, egg white, and other nutrients needed for a developing embryo. Chicken eggs are typically eaten for their nutritional content and can be cooked in various ways, such as boiled, fried, or scrambled.

Pig eggs: Pigs, being mammals, do not lay eggs like birds do. Instead, they reproduce through internal fertilization, and their offspring develop inside the mother's womb. When referring to "pig eggs," it's likely in reference to pig oocytes or ovum, which are the female reproductive cells involved in mammalian reproduction. These cells are microscopic and not something that can be consumed like a chicken egg.

In summary, chicken eggs are laid by hens and commonly consumed as food, while pig eggs (or more accurately, pig oocytes) are the female reproductive cells involved in pig reproduction and are not something that can be eaten.

[dpkirchner]

3.5 gets it, too, although it says "There is no such thing as pig eggs." Which is true enough in this context, I guess.

[jjj123]

That’s a better answer imo. Weird to talk about pig eggs as if they exist even though it seems to know that pigs don’t lay eggs.

[dpkirchner]

It seems like the sort of a thing a kid might ask, in which case the answer is too detailed (at least the initial answer, it'll simplify if asked).

[dogma1138]

Many of the answers ChatGPT gives would also what a human with average knowledge would give if you point a gun to their head and demand an answer.

My gut feeling is that global long term memory and what we call hallucinations right now might actually be the next step to get closer to general intelligence.

I’m not sure we have the right reinforcement models yet tho, as counter intuitive as it might sound I don’t think that a reinforcement model that is based on correctness only is what we need.

Humans make mistakes all the time, and we bullshit all the time. If anything I think that ChatGPT scares people not because it gets things right but because how confidently it gets things wrong which is something we do all the time.

Older “chat bots” and other NLP things like Watson seemed to be essentially glorified search engines they’ll either give you a correct answer or they won’t answer at all.

So they felt nothing more than a tool not unlike an encyclopedia. ChatGPT will produce an answer under most circumstances but it won’t be perfect and this is what people seem to anthropomorphize with the most.

[pokstad]

I saw a meme recently that illustrates this well:

“Old way: 2 hours to write code, 6 hours to debug code. New way: 5 minutes to tell chatgpt what to code, 24 hours to debug”

[kstenerud]

This is on par with arguing that automobiles will never amount to anything beyond an aristocratic toy because they can't navigate trails on their own like a horse can, can't feed like a horse can, and couldn't even go very far anyway without something breaking.

[dangoor]

Bing AI Chat actually searched for "are there cow eggs" before coming up with its answer: https://sl.bing.net/eDjeoPK4N76

> There is no such thing as cow eggs. Cows do not lay eggs. Chickens lay eggs that are commonly consumed by humans. The main difference between chicken eggs and other types of eggs is the way the chicken has been raised, treated, and fed. Different farming practices can affect the nutritional content of eggs12.

[hw]

Something my toddler would probably say as well. Does not mean my toddler has no intelligence - just not wired up to do that yet. Just as humans grow and mature through time, further iterations of AI models will as well

[insane_dreamer]

These are fixable as the model is improved, and learns which information to discard. The fact that gpt4 is already so less error prone that gpt3 shows the speed at which this is happening