[empath-nirvana]

GPT4 "knows" a lot more about most topics than any single human does. People have this idea that it absolutely needs to be perfectly correct at all times to be useful, but would never hold a human being to that standard.

How many times have you asked a co-worker about something and they gave you a convincing answer that was totally wrong? Did it make you stop asking co-workers for help?

[falsenapkin]

Coworkers answering wrong gets me to stop asking them for help, yes, especially if it's confident or they can't qualify uncertainty or I know their ratio of Q&A site visits vs 1st party docs visits is abysmal. There are even people I won't ask for help because they trust people that I don't trust.

Conversely, there are people who I will go to for topics that they are not the SME in, maybe their teammate even is, but I trust their ability to do quality research and intelligently interpret that research for case specific nuances. Like I'll go to the networking guy to talk about some DB thing because the DB guys are morons and live and die by junk SEO sites but the networking guy can think analytically and find the source of truth documentation and provide excerpts from it.

[ToucanLoucan]

I VERY much more trust a coworker to know things than I do this AI, especially given not just the subject of this thread, but the larger conversation around it. ChatGPT has a reputation already for just spewing out complete nonsense. Didn't Bing's implementation argue with someone about what freaking year it was not awfully long ago?

These chat bots "know" a shit ton and a half of stuff in that they are connected to the largest collection of knowledge known to man, the Internet. But "knowing" and "understanding" are two different things. The various search engines also "know" a ton about where to find things online, that doesn't mean they know shit about those things. And as we're seeing here: without the context to know that when someone wants an IP scanner, they want something good, that won't give their computer malware, that'll be reasonably priced or even open source, or even what platform, it just gives an answer based on a search.

You could just search for ip scanning software and gotten all the information BingGPT shared with the author of the piece.

And like, if you wanted to be charitable, you could say "well the author should've given more information about what they wanted" but again, that's not different from an existing search engine and more crucially: the AI didn't ask questions. Didn't ask for platform, how much they wanted to spend, if they preferred open source, or even something more general like what they were trying to accomplish. Nada. Just did a search, and reported results.

[TeMPOraL]

> Didn't Bing's implementation argue with someone about what freaking year it was not awfully long ago?

I'm sorry, but that's a stellar example of holding an LLM wrong. These models are frozen in time.

> But "knowing" and "understanding" are two different things.

Indeed, and that is a big part of misunderstanding. GPT-4 is, on many topics, closer to understanding than knowing (note that neither is a subset of the other). The conceptual patterns are there, even if sometimes are easy to accidentally overpower by the prompt, or by the sequence of tokens already emitted.

[ToucanLoucan]

> I'm sorry, but that's a stellar example of holding an LLM wrong. These models are frozen in time.

Y'all keep throwing out these gotcha statements that just make the technology you're trying to tell me is great seem more and more useless.

How can you even attempt to call something artificial intelligence if it doesn't even know the year it is!?

> Indeed, and that is a big part of misunderstanding. GPT-4 is, on many topics, closer to understanding than knowing (note that neither is a subset of the other). The conceptual patterns are there, even if sometimes are easy to accidentally overpower by the prompt, or by the sequence of tokens already emitted.

I don't think it's either understanding or knowing. Someone who knows something isn't going to spontaneously forget it because someone asked them a question incorrectly.

[TerrifiedMouse]

> Did it make you stop asking co-workers for help?

That specific unreliable coworker who doesn’t properly qualify that they aren’t completely certain … I believe for most people, yes.

We tend not to trust bullshitters.

[mrguyorama]

>How many times have you asked a co-worker about something and they gave you a convincing answer that was totally wrong?

Never actually. My coworkers have never told me something with confidence that they just made up. If they don't know an answer, they may provide hints and directions, but it will be clear they don't know.

[ChatGTP]

Maybe I just work with good people but I feel the same. Often we will verify things together but I’d say they never they just make things up.

[toofy]

> Did it make you stop asking co-workers for help?

i mean, in many circumstances, we absolutely stop asking them...

when i ask a trustworthy human a question, they will absolutely tell me if it is out their depths. they understand their own limits on around the subject and say so. and if they understand a little, they’ll help point towards people who would be a better authority on the subject.

that’s basic level human connection stuff.

if someone confidently gives you the wrong answer, refuses to know their own limits, and repeatedly leads you astray you don’t trust them after this do you?

[noAnswer]

> Did it make you stop asking co-workers for help?

One usually stops asking the bullshitter, yes.