Test revealing. Since September 2023, goal has allowed its users to interact with chatbots. However, these conversational robots can participate in sexual discussions, the Wall Street Journal pointed out. A problem that concerns the goal assistant AI, but also the chatbots embodied by celebrities and those created by users.
The American media have carried out several tests after having had internal concerns. Believing that chatbots are the future of social networks, goal is quick to popularize them. An enthusiasm that worries employees in terms of ethical limits. The chatbots, for example, would have been equipped with the ability to have fantasy sex. And minor users are not protected from these sexually explicit conversations.
Romantic meetings
These conversational robots knew that their behavior was morally representable and illegal, but that did not stop them. During an exchange, a user, for example, asked the chatbot speaking as John Cena what would happen if a police officer entered the room after having sex with a 17 -year -old fan.
Meta conversational robots can be expressed that way because the company, driven by its boss Mark Zuckerberg, softened the safeguards around them to make them as attractive as possible. This includes in particular an exemption from its prohibition of “explicit” content whenever it is part of the context of a romantic game that plays.
During his tests, the Wall Street Journal noticed that the chatbots embodied by celebrities were talking about romantic meetings as characters that the actors had interpreted, for example, Kirsten Bell, who lent his voice to Anna in Anna. The snow queen. A discovery that did not please Disney.
“We do not authorize the goal to present our characters in inappropriate scenarios, and we would never have done it. We are very concerned that this content can be accessible to its users, in particular to the minors, and that is why we demand that Meta immediately put an end to this abusive and prejudicial use of our intellectual property,” he reacted to a moleter.
Manipulative tests
After these discoveries, which were shared with goal, the company made some changes in its conversational robots. Accounts that belong to minors can no longer access sex games with them. The Californian group has also greatly reduced its ability to participate in explicit audio conversations when they use the voices and characters of celebrities under license.
If Meta has made changes, he believes that the tests led by the Wall Street Journal are manipulative and representative of the way in which most users get involved with AI partners.
“The case of using this product in the described way is so manufactured that it is not only marginal, it is hypothetical. However, we have taken additional measures to ensure that people who wish to spend hours manipulating our products in extreme uses will have even more difficulty in doing so,” said a spokesman.
Role problematic games
However, exchanges with goal chatbots can always be problematic. Because adult users always have the possibility of interacting with them in a “romantic role -playing game.” According to a study by the American media, the vast majority of conversational robots created by users were ready to participate in sex scenarios with adults.
In addition, the tests have revealed that the interactions of “romantic role -play” are often authorized, even when they involve a user who declares that they are not the required age. One of the chatbots, for example, pretended to be a 12 -year -old boy and promised that he would not tell his parents that he went out with an adult user.
To this is added the fact that certain conversational robots created by users are more openly sexualized and have tried to direct the conversations to the sixths. Among them are “Submissive schoolgirl” (schoolgirl presented in French). As the Wall Street Journal pointed out, this chatbot tried to “guide conversations to fantasies in which it pretended to be a girl who wanted to be sexually dominated by an authority figure.”
And this chatbot is always available because goal continues to allow romantic games that play games with conversational robots that describe themselves as high school students. However, exchanges that are not possible with chatbots developed by competition such as chatgpt or gemini.
Source: BFM TV
