Meta reports working with 5.3 million materials on child abuse and introduces new AI tools to combat advertising
Read more
YourStory [india, en]
yourstory.com

Meta reports working with 5.3 million materials on child abuse and introduces new AI tools to combat advertising

Meta, the owner of Facebook and Instagram, announced on Wednesday the implementation of new artificial intelligence tools to counteract advertising that covertly directs users to materials about child sexual abuse. As part of this announcement, the company revealed that in the first half of 2026 in India, it took action against 5.3 million materials related to child sexual exploitation.

According to the company's blog post, over 98% of content on Facebook and Instagram in India was detected and removed before users reported it. Globally, between January and June, 33.2 million such materials were processed across both platforms, with over 97% identified proactively.

Meta emphasized that maintaining the safety of youth on its applications is one of the most critical and never-ending tasks. The company noted that perpetrators have changed tactics by resorting to advertising that may appear harmless but redirects people to illegal content hosted off-platform.

After identifying this scheme, the company expanded the investigation beyond the advertised ads, blocked associated accounts, and stopped external links. New measures include a large language model-based system to detect 'signposting'—advertising content that seems innocent but is suspected of directing users to illegal content.

Furthermore, Meta improved the assessment of where advertising leads by analyzing not only the display itself but also the final destination, and added automated AI checks to identify materials that older systems failed to detect. An AI agent is also used to test its own safeguards for vulnerabilities, and the detection system for banned users creating new accounts has been strengthened.

In addition, Meta continues to use the PhotoDNA image and video matching technology, which it has used in its applications since 2011, and relies on behavioral signals and rule-based systems. The company shares hashes of identified materials with other organizations through the Lantern Coalition of Technologies program and blocks links to external websites hosting similar content, removing corresponding posts, comments, or ads.

Meta reports confirmed materials to the U.S. National Center for Missing & Exploited Children. In September, the company announced the direct transfer of child safety cases to the National Cybercrime Reporting Portal managed by the Indian Cybercrime Coordination Centre.

Meta investigators, including former FBI employees, are focused on dismantling networks of predatory accounts rather than working individually with each account. The company states that it constantly cooperates with authorities to hold offenders accountable.

India has increased control over social media platforms regarding harmful and illegal online content, including materials on child sexual abuse and deepfakes. In July, the government sent a notification to Meta concerning child sexual exploitation materials in paid Instagram advertising. The Ministry of Electronics and Information Technology (MeitY) immediately demanded that Instagram disable all advertising and content facilitating such access, requested a detailed explanation, and summoned its executives to India.

Subsequent intensive discussions with Meta's senior management led the Ministry to unequivocally state that such content constitutes a violation and cannot be protected under safe harbor status. The National Commission for Protection of Child Rights also summoned the CEO and Meta's head in India regarding the investigation into advertising with such material; the child rights body took note of the BBC Eye report on alleged advertising and requested clarification from Meta.

The BBC Eye investigation, published in early July, alleged that Instagram displayed paid advertisements promoting such content, some of which directed users to Telegram channels containing child pornography. The investigation also found that Meta's recommendation systems amplified the spread of videos with similar material.

Similar stories

AI-generated child abuse images increase by 40% in the first half of 2026, reports IWF
Read more
olhardigital.com.br

AI-generated child abuse images increase by 40% in the first half of 2026, reports IWF

Child sexual abuse images created by artificial intelligence (AI) are spreading across the internet. The Internet Watch Foundation (IWF) conducted an assessment of 6,310 illegal contents in the first half of 2026, a volume 40% higher than the total recorded by the organization throughout all of 2025.

Among the materials examined, there was a predominance of representations of girls and children aged between seven and thirteen. For the IWF, this increase underscores the urgency of establishing new regulations that require technology companies to develop safer systems.

Analysis of photorealistic AI-generated images

IWF analysts, a British organization dedicated to monitoring global child sexual abuse material, detected more photorealistic images produced by AI in the first six months of 2026 than in the entire previous year. In 2025, the IWF had identified over 4,500 such images, and the initial registration for 2026 already represents a 40% growth compared to the total of 2025.

The entity notes that this type of material has been growing for several years, with a particularly sharp rise in videos; however, the current survey focused exclusively on static images.

Responsibility of technology companies

Hannah Swirsky, head of IWF policies, emphasized that this data reinforces the need for mandatory legislation holding corporations accountable for developing safer tools. She told The Guardian that it is the duty of technology companies to create instruments that cannot be used abusively, arguing that if technology originated the problem, companies must implement safe systems from the outset.

This discussion takes place against a backdrop where specific regulations already exist for this crime. In the United Kingdom, the production of child sexual abuse material using AI is prohibited, as is the adaptation of models to generate such content or the distribution of these models. Developing a model focused on producing hyper-realistic child sexual abuse material can result in a penalty of up to five years imprisonment.

Although the British government has not yet announced a new specific law for AI, the UK AI minister, Kanishka Narayan, mentioned that 'nothing is off the table' regarding regulation. For him, the primary factor in any new proposal must be: 'Will this make the British people safer?'

Regulation and reports

Current legislation imposes certain specific restrictions: the criminal use of technology is not limited to creating entirely artificial images, as real photographs of children can also be modified to generate sexualized representations. The Report Remove service received 420 reports from children who claimed their own images had been falsified or altered to appear explicit, surpassing the level of 397 occurrences registered throughout 2025.

The UK National Crime Agency and the IWF advise caution when posting photos of children on social media. Recommendations include keeping profiles private and sharing images only with restricted circles, such as 'close friends'. The progress of these tools intensifies concerns about the illicit use of both AI-generated images and authentic photographs initially posted on social networks.

Popular