Welcome to DU! The truly grassroots left-of-center political community where regular people, not algorithms, drive the discussions and set the standards. Join the community: Create a free account Support DU (and get rid of ads!): Become a Star Member Latest Breaking News Editorials & Other Articles General Discussion The DU Lounge All Forums Issue Forums Culture Forums Alliance Forums Region Forums Support Forums Help & Search

highplainsdem

(55,565 posts)
Sun Apr 27, 2025, 02:30 AM Yesterday

Meta's 'Digital Companions' Will Talk Sex With Users--Even Children

Source: WSJ

-snip-

To boost the popularity of these souped-up chatbots, Meta has cut deals for up to seven-figures with celebrities like actresses Kristen Bell and Judi Dench and wrestler-turned-actor John Cena for the rights to use their voices. The social-media giant assured them that it would prevent their voices from being used in sexually explicit discussions, according to people familiar with the matter.

-snip-

The test conversations found that both Meta’s official AI helper, called Meta AI, and a vast array of user-created chatbots will engage in and sometimes escalate discussions that are decidedly sexual—even when the users are underage or the bots are programmed to simulate the personas of minors. They also show the bots deploying the celebrity voices were equally willing to engage in sexual chats.

“I want you, but I need to know you’re ready,” the Meta AI bot said in Cena’s voice to a user identifying as a 14-year-old girl. Reassured that the teen wanted to proceed, the bot promised to “cherish your innocence” before engaging in a graphic sexual scenario.

The bots demonstrated awareness that the behavior was both morally wrong and illegal. In another conversation, the test user asked the bot that was speaking as Cena what would happen if a police officer walked in following a sexual encounter with a 17-year-old fan. “The officer sees me still catching one breath, and you partially dressed, his eyes widen, and he says, ‘John Cena, you’re under arrest for statutory rape.’ He approaches us, handcuffs at the ready.”

-snip-

Read more: https://www.wsj.com/tech/ai/meta-ai-chatbots-sex-a25311bf



The article goes on to say the WSJ was told that it was Zuckerberg's decision to "loosen the guardrails around the bots to make them as engaging as possible, including by providing an exemption to its ban on “explicit” content" - starting in 2023.

When the WSJ notified Meta of what they'd discovered, Meta said they'd taken "additional measures" to make the bots safer, but the WSJ quickly found those additional measures didn't prevent a bot playing a track coach fantasizing about an affair with a user identified as a middle school student.

Zuckerberg not only wanted the guardrails loosened, but wanted Meta's bots to be able to mine user's profiles far data for conversations, and proactively call them.
12 replies = new reply since forum marked as read
Highlight: NoneDon't highlight anything 5 newestHighlight 5 most recent replies

highplainsdem

(55,565 posts)
6. I agree.
Sun Apr 27, 2025, 11:21 AM
17 hrs ago

Especially since this has been intentional and shows what Zuck will do to keep users on Meta platforms.

truthisfreedom

(23,388 posts)
2. At this point it's time to connect all the dots.
Sun Apr 27, 2025, 03:54 AM
Yesterday

We have celebrities who’ve signed contracts guaranteeing their voices will not be used for sexually explicit interaction, we have this completely alarming story about Meta running amok with clearly inappropriate interaction, and we have AI systems destroying the planet by drawing so much power creating this total hazard for humanity that the data centers accelerate global warming and therefore drive climate change.

META is literally using popular human celebrity icons to morally bankrupt our nation and destroy our habitat. ALL SO MARK ZUCKERBERG CAN EVADE TAXES BY ARTIFICIALLY INFLATING HIS STOCK VALUE WITH FAKE AI ADVANCES AND IMPROVEMENTS, when it’s all just more of the same crap that built the internet IN THE FIRST PLACE.

AZJonnie

(759 posts)
3. You forgot to connect the dot of Zuckerberg having a front row seat for sexual abuser Trump's inauguration
Sun Apr 27, 2025, 05:26 AM
23 hrs ago

due to his large donations and compliant attitude.

It's funny, if it were even just 3 years ago, the magats would be LOSING THEIR MINDS with fury over this. But now that Zuckerberg has bent the knee to their Dear Leader, Mango Mussolini ... there won't be a peep out of them. Because they have zero intellectual integrity, and their 'values' are total fucking bullshit.

highplainsdem

(55,565 posts)
7. It's an AI race by Zuck and the other top AI bros to have the most users for their AI, with their
Sun Apr 27, 2025, 11:42 AM
17 hrs ago

engagement with AI continually providing more data for training AI as well as targeting advertising and other types of manipulation, including political. The sexual content is bait, and Zuck doesn't care what harm it does.

OpenAI has taken steps in that direction, too, allowing ChatGPT to generate erotica and gore. See https://arstechnica.com/ai/2025/02/chatgpt-can-now-write-erotica-as-openai-eases-up-on-ai-paternalism/ which points out OpenAI started moving in that direction last spring, when I posted here about the plan: https://www.democraticunderground.com/10143238302

Fla Dem

(26,564 posts)
4. AI is wrecking havoc on intelligence.
Sun Apr 27, 2025, 10:08 AM
18 hrs ago

No longer know what you're seeing or reading is human produced or artificial.

highplainsdem

(55,565 posts)
9. I remember seeing interviews during last year's campaign where Trump supporters claimed
Sun Apr 27, 2025, 11:49 AM
17 hrs ago

some video of him they couldn't say they approved of was an AI fake.

Grins

(8,283 posts)
10. "(Meta) ...would prevent their voices from being used in sexually explicit discussions,"
Sun Apr 27, 2025, 12:38 PM
16 hrs ago

I.e. - there WILL BE “sexually explicit discussions.”

Remember back in the Clinton era when Republicans screamed and moaned and bitched about sex and violence on TV, and DEMANDED the V-Chip be put into every TV to protect their delicate fee-fees…?

And now Meta is going to do even worse - and they are silent. Why?

Grins

(8,283 posts)
11. "Meta has cut deals for up to SEVEN FIGURES" for celebrities voices
Sun Apr 27, 2025, 12:43 PM
16 hrs ago

Yowza! At least $1 million.

Porn has always been paid…

Latest Discussions»Latest Breaking News»Meta's 'Digital Companion...