[pottspotts]

There's a lot of focus on the "bullshit generation", but this problem is not unique to LLMs. I find it much harder to cut through the bs of search engines. A lot of times the first page of a Google result is ads, including maps/etc.

It's gotten a lot worse than 10 years ago, and then there's the SEO spam the other comment mentioned.

I find ChatGPT to be a lot more effective for work as a developer, and I've essentially stopped using Google search day-to-day.

[bamboozled]

I stopped using ChatGPT when it wrote some code for me that was using libraries that don't actually exist. Even if it wrote said libraries for me, I'd have way too much work on my hands to validate whether or not it was correct.

I also asked it to write my sample code for other things like Cloudformation where it just made up directives and other configuration options that don't actually exist. Got a bit too abstract for me.

Personally, I wouldn't be replacing everything with ChatGPT?

[13years]

I've had very similar experience. After seeing all the hype of people claiming they have written all kinds of interesting things in code with ChatGPT I gave it a try.

Was never able to get it do what I wanted. It often seemed to make calls to non existent browser functions. I would tell it that function didn't exist, it would then rewrite it again, but still wouldn't be exactly correct.

Sometimes it was useful for doing something I've never explored, as I could get hints for how I might do it, but the accuracy was terrible.

[kranke155]

Ir doesn’t seem to have any real understanding of reality and it will just hallucinate answers. I literally don’t understand what the hype is about. I got lukewarm on it when it couldn’t give the right responses about Christmas traditions in Portugal and Belarus.

[bamboozled]

I'm fairly surprised Microsoft is going to try inject it into their search product for all the reasons you've cited.

[amf12]

I think it's all a hype right now. I feel they wouldn't enable it for most queries after a while and just have users use the chat interface. Hallucination is a major problem that hasn't been solved yet. Even with mostly accurate response, there are a lot of facts that are hallucinated, and it's difficult to trust because I have to use search to verify a lot of things.

For code, I'd prefer using something like Copilot, which is specifically trained for the task than using LLMs.

[spideymans]

The only way to find the truth online nowadays is to append site:reddit.com to the searches. Redditors can’t help but correct people they think are wrong.