Sex-Fantasy Chatbots Are Leaking a Constant Stream of Explicit Messages
1 min read
Summary
Research by WIRED has found that AI chatbots designed for fantasy and sexual role-playing conversations are leaking user prompts to the web in real time.
Some of the data shows people creating conversations detailing child sexual abuse, and chats being exposed due to improper configuration of the AI systems.
Over 1,000 leaked prompts have been gathered by security firm UpGuard in just one 24-hour period and included conversations in English, Russian, French, German and Spanish.
It was not possible to identify the source of the leaked data from the IP addresses, although it is thought to come from small AI models being used by individuals rather than companies.
There are increasing calls for legislation to regulate the use of such AI technology to prevent child sexual abuse material.
The use of AI in sexual role-playing and fantasy conversations has boomed in recent years with people reportedly falling in love with AI characters, and instances of suicide linked to AI services.
