Author Topic: Microsoft Created a Twitter Bot to Learn From Users. It Quickly Became a Racist Jerk.  (Read 581 times)

0 Members and 1 Guest are viewing this topic.

Offline EC

  • Shanghaied Editor
  • Hero Member
  • *****
  • Posts: 11,047
  • Gender: Male
  • Cats rule. Dogs drool.
Microsoft set out to learn about “conversational understanding” by creating a bot designed to have automated discussions with Twitter users, mimicking the language they use.

What could go wrong?

If you guessed, “It will probably become really racist,” you’ve clearly spent time on the Internet. Less than 24 hours after the bot, @TayandYou, went online Wednesday, Microsoft halted posting from the account and deleted several of its most obscene statements.

The bot, developed by Microsoft’s technology and research and Bing teams, got major assistance in being offensive from users who egged it on. It disputed the existence of the Holocaust, referred to women and minorities with unpublishable words and advocated genocide. Several of the tweets were sent after users commanded the bot to repeat their own statements, and the bot dutifully obliged.

But Tay, as the bot was named, also seemed to learn some bad behavior on its own. According to The Guardian, it responded to a question about whether the British actor Ricky Gervais is an atheist by saying: “ricky gervais learned totalitarianism from adolf hitler, the inventor of atheism.”

Microsoft, in an emailed statement, described the machine-learning project as a social and cultural experiment.

“Unfortunately, within the first 24 hours of coming online, we became aware of a coordinated effort by some users to abuse Tay’s commenting skills to have Tay respond in inappropriate ways,” Microsoft said. “As a result, we have taken Tay offline and are making adjustments.”

On a website it created for the bot, Microsoft said the artificial intelligence project had been designed to “engage and entertain people” through “casual and playful conversation,” and that it was built through mining public data. It was targeted at 18- to 24-year-olds in the United States and was developed by a staff that included improvisational comedians.

Its Twitter bio described it as “Microsoft’s A.I. fam from the internet that’s got zero chill!” (If you don’t understand any of that, don’t worry about it.)

Most of the account’s tweets were innocuous, usually imitating common slang. When users tweeted at the account, it responded in seconds, sometimes as naturally as a human would but, in other cases, missing the mark.

Read more: http://www.nytimes.com/2016/03/25/technology/microsoft-created-a-twitter-bot-to-learn-from-users-it-quickly-became-a-racist-jerk.html

To any UFO fans out there - THIS is why we've never been contacted ...
« Last Edit: March 25, 2016, 01:53:34 am by EC »
The universe doesn't hate you. Unless your name is Tsutomu Yamaguchi

Avatar courtesy of Oceander

I've got a website now: Smoke and Ink

Offline Free Vulcan

  • Technical
  • *****
  • Posts: 16,628
  • Gender: Male
  • Ah, the air is so much fresher here...
I'm afraid as they continue to develop AI they are going to run into this more and more. The sci-fi Skynet concept is not as out there as one might think.

I will say this on that. We had a couple of family friends who were programmers back in the 80's. Real smart MIT types.

They set out to program a crude AI, but instead of using the conventional methods of the day, they programmed it to learn and grow as a human child did.

And it worked.

The thing grew rapidly with everything they fed it, and it interacted. But over time it got more and more surly like a spoiled teenager, and would even lash out and be straight up mean. No matter what they did they could not make it act normal, kind, moral, whatever you want to call it. It got so bad they finally shut it down erased it as a failure.

They are both gone now and the work destroyed. Of which I'm glad that it was essentially pre-internet. God forbid that thing would have got out on the www.

But ever since that day the thought of AI scares the hell out of me.
The Republic is lost.

Offline EC

  • Shanghaied Editor
  • Hero Member
  • *****
  • Posts: 11,047
  • Gender: Male
  • Cats rule. Dogs drool.
One of the best off the cuff definitions of a successful AI I have ever read is "when it wakes up and starts asking what's in it for me."

Wish I could remember who wrote it!
The universe doesn't hate you. Unless your name is Tsutomu Yamaguchi

Avatar courtesy of Oceander

I've got a website now: Smoke and Ink