Earlier this year researchers at Facebook Artificial Intelligence Research built a chatbot which was supposed to learn trading and bartering as humans did.
Unfortunately facebook had to shut down the pair because it invented its own weird and creepy language . The researchers paired two of the bots which were nicknamed “Alice” and “Bob” to trade against each other, they started using a language far different from the ordinary English language we are familiarized with.
The chatbot conversation “led to divergence from human language as the agents developed their own language for negotiating,” the researchers said.
Facebook’s AI language
Bob: i can i i everything else . . . . . . . . . . . . .
Alice: balls have zero to me to me to me to me to me to me to me to me to me
Bob: you i everything else . . . . . . . . . . . .
Alice: balls have a ball to me to me to me to me to me to me to me
Bob: i i can i i i everything else . . . . . . . . . . . .
Alice: balls have a ball to me to me to me to me to me to
Bob: i . . . . . . . . . . . . . . . . . . .
Bizzare right the two bots were supposed to be learning to trade balls, hats and books, assigning value to the objects then bartering them between each other.
But since Facebook’s team assigned no reward for conducting the trades in English, the chatbots quickly developed their own terms for deals.
“There was no reward to sticking to English language,” Dhruv Batra, Facebook researcher, told FastCo. “Agents will drift off understandable language and invent codewords for themselves.
“Like if I say ‘the’ five times, you interpret that to mean I want five copies of this item. This isn’t so different from the way communities of humans create shorthands.”
After shutting down the the incomprehensible conversation between the programs, Facebook said the project marked an important step towards “creating chatbots that can reason, converse, and negotiate, all key steps in building a personalized digital assistant”.
Facebook said when the chatbots conversed with humans most people did not realise they were speaking to an AI rather than a real person.
The researchers said it wasn’t possible for humans to crack the AI language and translate it back into English. “It’s important to remember, there aren’t bilingual speakers of AI and human languages,” said Batra.