Hacker News new | ask | show | jobs
by vicnov 818 days ago
I would have been on board with it, if I didn’t get a completely wrong AI generated response from Google the other day.

I was for some reason looking into history of Reddit and ended up searching “what happened to former AMA coordinator Victoria Taylor”. Google AI summary got confused and told me that she got fired because hundreds of redditors voted for her ouster (clearly mixing up Victoria’s story and Ellen Pao’s)

I know n=1, but feels like maybe a little too early to get it out of the experimental mode.

1 comments

I think this points to bigger issues with the AI field generally with respect to adoption and development. The output of these systems is fundamentally unverifiable. Building a system to verify these answers would be orders of magnitude more expensive and maybe computationally impossible. It looks really impressive because it's 95% of the way there, but 5% error rate is atrocious, in was expensive to get this far, and improving it much more will be more and more expensive. What we've essentially built is a search engine that is 5 times more expensive to operate and that alienates the content from its context, which makes it less valuable.

Maybe it's good enough for programming since you can immediately verify the output but I suspect we're pretty far away from the breakthroughs ai boosters insist we are mere months away from. We've had some form of self driving for a while now and the other company that seems close is waymo, and that seems to have taken over a decade of huge research and capital expenditures.