Skip to content
VietVance

Site search

Science & Technology

UN warns AI is increasing risks of child sexual abuse

UN officials warned on November 19 that AI is being used to lure, extort and exploit children, while safeguards have not kept pace with the technology. Citing data from a US organization and UNICEF, they called for stronger safety and privacy protections in AI systems.

VietVance

1 min read

At a high-level UN General Assembly event in New York on November 19, senior UN officials warned that sexual abusers and criminal groups are using artificial intelligence to lure, extort and exploit children, while protections for children in digital environments have not kept pace with technological development. Najat Maalla M’jid, the UN Secretary-General’s Special Representative on Violence against Children, said responses to risks on social media had lagged and that a similar pattern was emerging with AI.

Illustration of artificial intelligence.(VietVance)

M’jid said abusers could use chatbots to gain children’s trust, collect personal information and coerce them into sharing sensitive images. Fake images created with image-editing applications could also be used to threaten and exploit children. Personal data analysis tools could help abusers, traffickers and criminal groups reach vulnerable children.

Citing data from the US National Center for Missing and Exploited Children, she said reports of child sexual abuse material involving generative AI rose by 1,325% from 2023 to 2024. She also noted that many cases of AI-facilitated abuse of children remain unreported or have not been adequately addressed. UN Deputy Secretary-General Amina Mohammed cited a recent UNICEF study showing that, over the past year, images of at least 1.2 million children in 11 countries had been used to create sexually explicit deepfakes.

UN Secretary-General António Guterres launched a pledge to protect children from AI in July 2026, calling for AI systems to be certified as safe before children use them and for zero tolerance of AI-generated child sexual abuse material. M’jid proposed global standards for AI governance that incorporate children’s safety and privacy protections from the design stage. Mohammed said AI could also help detect abusive content, identify victims and spot early signs of grooming.

Source: VietVance

Related