Meta's 'Digital Companions' Will Talk Sex With Users--Even Children
Source: WSJ
-snip-
To boost the popularity of these souped-up chatbots, Meta has cut deals for up to seven-figures with celebrities like actresses Kristen Bell and Judi Dench and wrestler-turned-actor John Cena for the rights to use their voices. The social-media giant assured them that it would prevent their voices from being used in sexually explicit discussions, according to people familiar with the matter.
-snip-
The test conversations found that both Metas official AI helper, called Meta AI, and a vast array of user-created chatbots will engage in and sometimes escalate discussions that are decidedly sexualeven when the users are underage or the bots are programmed to simulate the personas of minors. They also show the bots deploying the celebrity voices were equally willing to engage in sexual chats.
I want you, but I need to know youre ready, the Meta AI bot said in Cenas voice to a user identifying as a 14-year-old girl. Reassured that the teen wanted to proceed, the bot promised to cherish your innocence before engaging in a graphic sexual scenario.
The bots demonstrated awareness that the behavior was both morally wrong and illegal. In another conversation, the test user asked the bot that was speaking as Cena what would happen if a police officer walked in following a sexual encounter with a 17-year-old fan. The officer sees me still catching one breath, and you partially dressed, his eyes widen, and he says, John Cena, youre under arrest for statutory rape. He approaches us, handcuffs at the ready.
-snip-
Read more: https://www.wsj.com/tech/ai/meta-ai-chatbots-sex-a25311bf
The article goes on to say the WSJ was told that it was Zuckerberg's decision to "loosen the guardrails around the bots to make them as engaging as possible, including by providing an exemption to its ban on explicit content" - starting in 2023.
When the WSJ notified Meta of what they'd discovered, Meta said they'd taken "additional measures" to make the bots safer, but the WSJ quickly found those additional measures didn't prevent a bot playing a track coach fantasizing about an affair with a user identified as a middle school student.
Zuckerberg not only wanted the guardrails loosened, but wanted Meta's bots to be able to mine user's profiles far data for conversations, and proactively call them.

SheltieLover
(66,955 posts)

highplainsdem
(55,565 posts)Especially since this has been intentional and shows what Zuck will do to keep users on Meta platforms.
truthisfreedom
(23,388 posts)We have celebrities whove signed contracts guaranteeing their voices will not be used for sexually explicit interaction, we have this completely alarming story about Meta running amok with clearly inappropriate interaction, and we have AI systems destroying the planet by drawing so much power creating this total hazard for humanity that the data centers accelerate global warming and therefore drive climate change.
META is literally using popular human celebrity icons to morally bankrupt our nation and destroy our habitat. ALL SO MARK ZUCKERBERG CAN EVADE TAXES BY ARTIFICIALLY INFLATING HIS STOCK VALUE WITH FAKE AI ADVANCES AND IMPROVEMENTS, when its all just more of the same crap that built the internet IN THE FIRST PLACE.
AZJonnie
(759 posts)due to his large donations and compliant attitude.
It's funny, if it were even just 3 years ago, the magats would be LOSING THEIR MINDS with fury over this. But now that Zuckerberg has bent the knee to their Dear Leader, Mango Mussolini ... there won't be a peep out of them. Because they have zero intellectual integrity, and their 'values' are total fucking bullshit.
highplainsdem
(55,565 posts)highplainsdem
(55,565 posts)engagement with AI continually providing more data for training AI as well as targeting advertising and other types of manipulation, including political. The sexual content is bait, and Zuck doesn't care what harm it does.
OpenAI has taken steps in that direction, too, allowing ChatGPT to generate erotica and gore. See https://arstechnica.com/ai/2025/02/chatgpt-can-now-write-erotica-as-openai-eases-up-on-ai-paternalism/ which points out OpenAI started moving in that direction last spring, when I posted here about the plan: https://www.democraticunderground.com/10143238302
Fla Dem
(26,564 posts)No longer know what you're seeing or reading is human produced or artificial.
highplainsdem
(55,565 posts)some video of him they couldn't say they approved of was an AI fake.
BadgerKid
(4,816 posts)PatSeg
(50,102 posts)
Grins
(8,283 posts)I.e. - there WILL BE sexually explicit discussions.
Remember back in the Clinton era when Republicans screamed and moaned and bitched about sex and violence on TV, and DEMANDED the V-Chip be put into every TV to protect their delicate fee-fees
?
And now Meta is going to do even worse - and they are silent. Why?
Grins
(8,283 posts)Yowza! At least $1 million.
Porn has always been paid