The call to action from the children’s commissioner for England is to have the government implement a ban on apps that utilize artificial intelligence (AI) to produce sexually explicit images of children. Dame Rachel de Souza emphasized the necessity for a complete prohibition on apps that enable “nudification,” the process in which AI edits photos of real individuals to make them appear nude, or can be used to generate sexually explicit deepfake images of minors. She highlighted the government’s failure to regulate such apps, which could have serious real-world repercussions.
Deepfakes, which are generated using AI to create realistic videos, images, or audio clips, have become a growing concern. In a recent report, Dame Rachel pointed out that this technology predominantly targets girls and young women, with a significant number of apps designed specifically for female bodies. She also observed a shift in children’s online behavior as they try to avoid falling victim to nudification apps. Many girls are now refraining from posting images or engaging online to minimize the risk of being exploited by such malicious technology.
In addition to the ban on AI-powered apps, Dame Rachel proposed several measures for the government to adopt in order to protect children from harm. These included imposing legal requirements on developers of generative AI tools, creating a systematic process for removing sexually explicit deepfake images of children from the internet, and acknowledging deepfake sexual abuse as a form of violence against women and girls. The concerns raised by the children’s commissioner were echoed by Paul Whiteman, general secretary of the school leaders’ union NAHT, who emphasized the urgent need for a review of existing laws and educational efforts surrounding this issue.
While laws in England and Wales already prohibit the sharing or threat of explicit deepfake images, the government has taken additional steps to address the growing threat posed by AI-generated child sexual abuse materials. Recent legislation introduced in February targeted the possession, creation, or distribution of AI tools designed for such purposes. The government also highlighted the dramatic increase in reports of AI-generated child sexual abuse incidents, emphasizing the need for stronger measures to combat this disturbing trend
Read the full article from The BBC here: Read More
