More teens using generative AI to create explicit content; parents urged to know risks

A disturbing trend shows a rising number of teenagers utilizing generative artificial intelligence (AI) to produce explicit content, sparking considerable alarm among parents and child safety advocates. A recent study revealed that over half of surveyed U.S. teens admit to creating sexual images of themselves or others using AI, with a similar number reporting they have received such images from peers. These "nudification apps" and other AI tools can alter real images to depict individuals without clothing, leading to serious legal and ethical issues, especially when underage users are involved or targeted.

The proliferation of this content has already resulted in significant harm, with victims reporting severe emotional trauma, including anxiety and lasting fear. Lawsuits have been filed against AI companies by teenagers claiming their images were used without consent to create explicit content. Furthermore, criminal cases have emerged, such as two 14-year-old boys in Pennsylvania sentenced to probation for creating hundreds of fake nude images of classmates, highlighting the real-world consequences and the classification of such AI-generated imagery involving minors as illegal child sexual abuse material.

Parents are expressing heightened concern, though many may not fully grasp the extent of sensitive personal information their children might share with AI. They desire child-specific AI platforms with age-appropriate content and robust parental control features, which are often lacking in current generative AI tools. Experts and organizations like UNICEF are calling for urgent action from governments, AI developers, and digital companies to implement better safeguards, more transparent security measures, and regulatory responses to mitigate the risks and protect minors from exploitation in this rapidly evolving digital landscape.