Hacker News new | ask | show | jobs
by cableshaft 3741 days ago
Anyone see this in action? What sort of vulnerability was being exploited? What types of things was the chatbot saying?
9 comments

The bot learned from interacting with users. A bunch of people took to bombarding Tay with racist/sexist/antisemitic remarks which worked their way into its vocabulary. I'm not sure if you could really call it a vulnerability as this is pretty much what the bot was designed to do. It's more of a flaw in the inability to properly filter the content that works its way into the AI.
Yeah, I think them calling it a "vulnerability" makes the entire post seem disingenuous.
I can understand them wanting to call it a "hack" for CYA purposes, but it's a cowardly position. Should we invoke the CFAA every time a company is embarrassed?
https://www.reddit.com/r/tay_tweets has lots of examples, most of them 4chan-level.

These few are completely different and certainly interesting: https://i.imgur.com/iVof3D4.jpg https://i.imgur.com/YwlfwyL.png https://i.imgur.com/IlpFUiZ.png (though it's hard to confirm they're legit, as Retr0spectrum points out).

I think the second one was fake.
You're probably right, even though I want to believe it wasn't.
The specific one they're describing is, I think, a feature that would have Tay echo anything you sent it. That one was somewhat more "annoying embarrassment" than "coordinated attack." The bigger problem was that Tay began spontaneously tweeting ugly statements, a problem that can be summed up as "When Twitter is your learning corpus, you are at risk of your learning corpus being made up of tweets."
I think the vulnerability was msft underestimating the extent of effort 4chan users would put into trolling Tay.

By the end of the day, Tay could 4chan with the worst of them.

Not sure of a "vulnerability", would like to hear more about that. Unless the "repeat after me" feature is a vulnerability or it learns to copy too much from input?

Here's a small sample: http://imgur.com/gallery/VhlAW

I suspect a Google Bomb style attack.

https://en.wikipedia.org/wiki/Google_bomb

Have you been living under a rock?....
I didn't catch it on HN, and I pretty much only check the boardgames subreddit on reddit now, so yeah, I guess that qualifies as living under a rock.