Apple again solves a problem that has been appearing more and more frequently around artificial intelligence in recent months. From App Store A few hours ago, he removed the Kromix app, which WIRED discovered was used to create pornographic deepfake images and videos of real people. Even more interesting is the fact that the app was promoted through ads on Facebookon Instagram.
You might be interested in
The application has passed the check. Apple
Kromix is in App Store presented itself as a tool for editing and stylizing images using AI. However, according to WIRED’s findings, it also offered features that allowed the creation of sexually explicit content using images of real people.
One of the ads was particularly problematic, according to the report. It featured a woman who looked strikingly like a prominent American politician. The shot then transitioned to a pornographic deepfake video that used her likeness. The ad also presented the app as an AI tool with no limitations. And that’s where it gets tricky. Apple into an unpleasant situation. Kromix was originally controlled by App Store passed. Apple he subsequently stated that the app likely added the banned features only after it was approved and made available to users.
Apple It also reminded that its rules have long prohibited apps designed to create, distribute or consume pornography. The rules also prohibit so-called "nudify" apps, which use AI to digitally remove clothing from photos of real people.
Do you still remember? App Store z iOS 10?
Apple removed the app after being notified
To remove Kromix from App Store however, it was not based on an automatic check. Apple The app was only removed after WIRED reporters brought it to its attention. The company subsequently said that in addition to the app itself, it was also working to remove developer accounts that were similarly trying to circumvent the rules. App Store.
This is not the first such case. WIRED also came across an app called MaskAI, which allowed people to upload photos and then use AI to insert people into sexually explicit situations. This app was also App Store removed after journalists became interested in its existence.
You might be interested in
ProThe problem also affects Meta.
The whole case is all the more interesting because Kromix was not only promoted on some dubious website. Its ads ran directly on Meta platforms, primarily on Facebookua Instagram. According to WIRED, the campaign ran a total of 32 ads that were targeted exclusively at men. Meta subsequently removed the ads after being notified, deleted the pages behind the campaign, and blocked the related URLs.
The case thus reopens the question of how well big tech companies can control content created with AI. Apple Although it officially bans such apps, some still manage to get past its controls. And Meta has enabled their promotion through its own advertising system.
It is clear that similar cases will increase with the development of generative AI. Technologies for creating realistic images and videos are improving very quickly, while Apple, Meta and other companies must also find ways to prevent their abuse. This time, Kromix from App Store disappeared, but the question remains how many similar applications can appear in it again.
Puritans!