Meta has come under fire after advertisements for an AI tool called Kromix, which generates non-consensual deepfake pornography of female politicians, were found running on its platforms.

  • Meta's ad network promoted 'Kromix,' an AI tool designed to create non-consensual intimate imagery.
  • Advertisements featured deepfakes resembling prominent US female politicians.
  • The tool allows users to manipulate real people's photos into pornographic scenarios.

In a massive failure of content moderation, Meta Platforms recently allowed advertisements for an AI-driven tool that encourages the creation of deepfake pornography. The tool, identified as Kromix, specifically targets the creation of non-consensual intimate imagery (NCII) involving real individuals, including high-profile US female politicians.

The advertisements, which bypassed Meta's strict policies against sexual content, utilized highly provocative imagery. One specific ad featured a woman closely resembling a prominent US politician standing before the American flag, before transitioning into a pornographic scene. The ad's voice-over explicitly boasted that the tool has "no restrictions" and is "the AI that men actually use," highlighting a predatory marketing strategy.

Read Also:Meta Apologizes for Accidental Removal of PM Modi's Video, Cites Technical Glitch

Why This Matters

BozokMedia analysis shows that this incident exposes a critical vulnerability in the automated advertising systems of big tech companies. The ability for malicious actors to use Meta's own infrastructure to promote tools that weaponize AI against women and political figures poses a direct threat to both individual privacy and democratic integrity.

The weaponization of AI to create non-consensual sexual content is one of the most urgent digital rights challenges of our era.

Beyond political targeting, the Kromix app—which was previously hosted on Apple's App Store—offers disturbing features. It invites paid users to upload photos to place them in scenarios ranging from "bedroom" settings to fictional character mashups. This demonstrates a systemic issue where AI tools are being marketed specifically for the purpose of digital harassment.

Historical Background

The rise of generative AI has outpaced the regulatory frameworks designed to control it. While deepfake technology was initially a novelty in cinema, it has rapidly evolved into a tool for disinformation and gender-based violence. Major platforms like Meta and Apple are under increasing pressure from global regulators to implement stricter safeguards against the monetization of AI-generated exploitation.

Did You Know?: Deepfake technology uses a process called 'Generative Adversarial Networks' (GANs), where two neural networks compete to create increasingly realistic fake imagery.

Frequently Asked Questions

Question 1: What is the Kromix app?
Answer: Kromix is an AI image styler that allows users to generate pornographic content by uploading photos of real people.

Question 2: How did these ads bypass Meta's security?
Answer: The ads likely exploited gaps in Meta's automated ad-review algorithms, which struggle to detect sophisticated AI-generated manipulations in real-time.