Hacker News new | ask | show | jobs
by MattGaiser 698 days ago
The problem with the Google one is accuracy. It told people to eat rocks. OpenAI just needs to beat that.
3 comments

It appears from the demo example, OpenAI is not winning in the accuracy department either: https://x.com/kifleswing/status/1816542216678179083

> In ChatGPT's recent search engine announcement, they ask for "music festivals in Boone North Carolina in august"

> There are five results in the example image in the ChatGPT blog post :

> 1: Festival in Boone ... that ends July 27 ... ChatGPT's dates are when the box office is closed [X] 2: A festival in Swannanoa, two hours away from Boone, closer to Asheville [X] 3. Free Friday night summer concerts at a community center (not a festival but close enough) [O] 4. The website to a local venue [X] 5. A festival that takes place in June, although ChatGPT's summary notes this. [Shrug]

Not saying the SearchGPT will or will not be accurate, but this demo was certainly made in After Effects. Who knows where the copy came from.
Even though placeholder copy is common in promos, a search engine demo is the one case where you need completely accurate copy.
Obvious errors make for good comedy and create obvious moments for reflection on what is actually being done. Subtle errors lead to fractured realities.
Google makes shittons of the subtle variety now as well.
They are both training on the same garbage. OpenAI's accuracy isn't any better.