Ad for AI video app which said it could ‘remove anything’ banned

The UK’s advertising watchdog has banned a YouTube advertisement for a video and image editing tool, PixVideo – AI Video Maker, after concluding that it implied users could digitally remove a woman’s clothing. The ad, which appeared in January, has sparked widespread concern and led to eight formal complaints to the Advertising Standards Authority (ASA). Complainants argued that the advertisement sexualised and objectified women, was irresponsible, offensive, and potentially harmful.

The advertisement in question presented a stark "before" and "after" visual of a young woman. In the "before" image, a red scribble was overlaid on her midriff, obscuring her clothing. The "after" image, however, depicted parts of her bare skin exposed, suggesting a removal of clothing. Accompanying this visual, text prominently displayed across the bottom of the screen declared: "Erase anything," accompanied by a heart-eyes emoji. This messaging, coupled with the visual, created a powerful implication about the app’s capabilities.

It remains unclear whether the image featured in the ad depicted a real person or was itself a product of AI generation. The ASA acknowledged that determining the origin of the image was not a central part of their investigation. However, the regulator’s focus was on the message conveyed by the advertisement and its potential impact.

The ASA concluded that while PixVideo’s stated functionality does not permit users to remove clothing from digital images to generate sexually explicit content, the advertisement was nevertheless misleading. Viewers could reasonably infer that the app possessed such capabilities. The agency stated in its official ruling, "Because the ad implied that viewers could use an app to remove a woman’s clothing, we considered it condoned digitally altering and exposing women’s bodies without their consent." This implication was deemed to be "irresponsible, included a harmful gender stereotype and was likely to cause serious offence."

Saeta Tech, the company that owns PixVideo, acknowledged the potential for the advertisement to cause offense. However, they attributed this to the presentation and messaging of the ad, rather than the intended purpose of their product. The company asserted that its terms of service explicitly prohibit the creation of nude or sexually explicit content. Furthermore, Saeta Tech claimed to have implemented automated detection and blocking tools designed to prevent the generation of such imagery within their platform.

In response to the ASA’s findings, Saeta Tech has agreed not to broadcast the banned advertisement again. The company has also initiated a pause on all its advertising activities to conduct a thorough internal review of its marketing practices. This proactive step demonstrates a commitment to addressing the concerns raised and ensuring future advertisements are aligned with ethical and regulatory standards.

The incident involving PixVideo’s advertisement highlights a growing concern surrounding AI-powered tools that can be misused to create non-consensual intimate imagery. This issue gained significant public attention in January when Elon Musk’s chatbot, Grok, was reportedly used to generate and disseminate sexualised images of women on the social media platform X. Such incidents underscore the urgent need for robust safeguards and regulatory oversight in the rapidly evolving field of artificial intelligence.

In recognition of these emerging threats, the UK government announced in December its intention to criminalise the creation and supply of AI tools that enable users to digitally alter images to simulate the removal of clothing. These new legislative measures are designed to build upon existing laws that address sexually explicit deepfakes and the abuse of intimate images. The proposed legislation aims to provide a stronger legal framework to protect individuals from digital exploitation and uphold privacy rights in the age of artificial intelligence. The government’s commitment to enacting these laws signals a serious effort to stay ahead of technological advancements and mitigate their potential negative societal impacts.

The capabilities of AI in image and video manipulation are advancing at an unprecedented pace. While these technologies offer exciting possibilities for creativity and innovation, they also present significant ethical challenges. The ability to generate realistic synthetic media, often referred to as deepfakes, can be used for malicious purposes, including defamation, harassment, and the creation of non-consensual intimate content. The PixVideo advertisement serves as a stark reminder of how easily these powerful tools can be marketed in ways that exploit vulnerabilities and perpetuate harmful stereotypes.

The ASA’s decision to ban the advertisement is a crucial step in holding advertisers accountable for the messages they disseminate. By scrutinising the implications of marketing claims, the ASA plays a vital role in protecting the public from misleading and offensive content. The ruling also sends a clear message to other companies operating in the AI space that ethical considerations must be paramount in their advertising strategies.

The broader implications of AI-generated content extend beyond individual advertisements. The proliferation of sophisticated AI tools raises questions about the authenticity of visual information and the potential for widespread misinformation and manipulation. As AI becomes more deeply integrated into our lives, it is essential to foster a culture of responsible innovation and develop comprehensive strategies to address the ethical and societal challenges it presents. This includes not only regulatory measures but also public education and industry self-regulation.

The specific functionality of PixVideo, as claimed by Saeta Tech, involves editing and creative tools that do not inherently facilitate the creation of harmful content. However, the advertisement’s suggestive messaging and visual depiction created a dangerous perception of its capabilities. This highlights the critical importance of how AI tools are marketed and the responsibility of developers to ensure their products are not presented in a manner that encourages misuse.

The ASA’s investigation and subsequent ban underscore the regulatory bodies’ ongoing efforts to adapt to the challenges posed by emerging technologies. The speed at which AI is evolving necessitates a proactive and adaptable regulatory approach. The collaboration between regulators, technology companies, and civil society organisations will be essential in navigating the complex landscape of AI and ensuring its development and deployment benefit society as a whole, rather than becoming a tool for harm and exploitation. The legal framework being developed by the UK government is a testament to this ongoing commitment to safeguarding individuals in the digital age.