Watchdogs warn parents to protect children from AI nudification apps and online abuse

Child safety watchdogs are issuing urgent warnings to parents about the alarming rise of AI-powered "nudification" applications and online groups that promote child sexual abuse material. These easily accessible tools can transform innocent photos of children into realistic sexually explicit images, often without the knowledge or consent of the child or their guardians. Organizations like the Internet Watch Foundation (IWF) and the National Crime Agency (NCA) have noted a significant surge in AI-generated child sexual abuse material, with reports indicating thousands of such images and videos identified in the past year alone.

The proliferation of these deepfake technologies poses severe risks, including profound emotional and psychological harm to victims, peer-to-peer abuse, and online blackmail. Experts are increasingly concerned that the realistic nature of AI-generated content makes it challenging to distinguish from actual abuse, potentially diverting resources and complicating efforts to identify and protect real children in danger.

In response to this escalating threat, watchdogs advise parents to take proactive steps such as limiting the public visibility of children's photos on social media, using private sharing settings, and regularly discussing online safety with their children. There are also growing calls for stronger legislation and for AI model providers to ensure their technologies are "safe by design" to prevent their misuse in generating harmful content.