Meta Faces Scrutiny After AI 'Nudify' Ads Found on Platforms

TECHNOLOGY
Whalesbook Logo
AuthorKavya Nair|Published at:
Meta Faces Scrutiny After AI 'Nudify' Ads Found on Platforms

Meta Platforms Inc. is under pressure after reports revealed thousands of ads for AI 'nudify' apps, linked to a Chinese partner, appeared on Facebook and Instagram. These apps, which create explicit imagery, violate Meta's safety policies. With 11% of Meta's global revenue coming from Chinese advertisers, the incident raises concerns about the balance between ad income and platform moderation.

Detailed Coverage

Meta Platforms Inc. is facing renewed scrutiny following reports that thousands of advertisements for AI-powered 'nudify' applications have been running on its Facebook and Instagram platforms. These applications allow users to superimpose faces onto sexually explicit imagery, a practice that directly violates Meta’s established policies against non-consensual intimate imagery and sexually suggestive content.

Role of Advertising Partners

The advertisements were reportedly facilitated by GatherOne Inc., a Beijing-based firm that serves as an advertising partner for Meta. While Facebook and Instagram are not accessible within China, the company relies heavily on Chinese businesses to drive international ad revenue. According to recent data, Meta generated $18.4 billion in sales from the Chinese market in 2024, representing approximately 11% of its total global revenue. This dependence on Chinese advertisers creates a complex environment for the company, as it attempts to maintain strict moderation standards while managing a high volume of international ad placements.

Regulatory and Policy Concerns

The investigation, conducted by the Tech Transparency Project, identified roughly 7,600 ads linked to these services. Some of these apps, including one identified as BAfter, were found to contain content that users flagged as child pornography. Although Meta has publicly stated that it prohibits such content and takes aggressive action against violators, the presence of these ads has sparked questions regarding the effectiveness of the company’s automated moderation tools and its oversight of third-party advertising partners.

Company Response and Actions Taken

Following inquiries regarding these advertisements, Meta confirmed that it has banned the BAfter app and blocked links to similar services. GatherOne has responded by announcing a suspension of new advertising accounts related to AI face-swap and 'nudify' services, citing a commitment to upgrading its compliance protocols. The company maintains that it follows international laws and Meta’s advertising standards.

For investors, the situation highlights a persistent risk regarding platform governance and brand safety. As AI technology makes it easier to create and distribute harmful content, social media companies face increasing pressure from regulators and the public to improve their detection systems. The ability of a company to effectively police its platform without sacrificing its advertising revenue model remains a critical monitorable for long-term platform stability and regulatory compliance. Future updates will likely focus on whether Meta introduces more stringent vetting processes for its international advertising partners to prevent similar policy failures.

Disclaimer: This article is published for informational purposes only. This is not a buy sell recommendation.