Вештачка интелигенција

The Rise of AI-Generated Pornographic Deepfakes and Their Ethical Concerns

Summary

With advancements in artificial intelligence (AI) technology, platforms enabling the creation of explicit content have emerged, raising ethical concerns. One such platform is AnyDream, which allows users to generate AI-generated images by uploading facial pictures. Unfortunately, it has been misused, […]

The Rise of AI-Generated Pornographic Deepfakes and Their Ethical Concerns

With advancements in artificial intelligence (AI) technology, platforms enabling the creation of explicit content have emerged, raising ethical concerns. One such platform is AnyDream, which allows users to generate AI-generated images by uploading facial pictures. Unfortunately, it has been misused, particularly in the creation of non-consensual pornographic deepfakes.

Recently, investigative company Bellingcat uncovered that AnyDream, an American AI company, had utilized the financial service of Stripe to raise funds for the creation of non-consensual pornographic deepfakes. This raised eyebrows as Stripe explicitly prohibits processing payments for adult content. AnyDream had utilized the Stripe account of its founder, Junyu Yang, through a third-party website under false pretenses to avoid detection.

To protect the privacy of the victims, Bellingcat refrained from disclosing their identities. However, the investigation successfully identified the victims due to AnyDream’s publication of the images on its website, along with the instructions used to create them, including their names.

AnyDream claimed that Yang had already left the company, but they had gained control of his Discord account, which was previously linked to his private account on an adult content website, until it was removed after Bellingcat contacted the company. AnyDream stated that the use of Yang’s name on the Stripe account was a “testing error” and assured that a new payment provider would be utilized soon.

Furthermore, Bellingcat discovered that Yang had directed users to make payments on his personal PayPal account, potentially violating PayPal’s terms of service, which also prohibit adult content. AnyDream stated that they have ceased using PayPal.

Frequently Asked Questions:

1. What is the purpose of the AnyDream platform?
The AnyDream platform allows users to generate pornographic content utilizing AI technology.[1]

2. How many people use the AnyDream platform?
AnyDream has over ten thousand followers on Instagram and more than three thousand members on their Discord server, where users share their AI-generated creations.[1]

3. Did AnyDream violate adult content payment rules?
Yes, AnyDream used Stripe’s financial service to collect funds for their pornographic deepfake generation service, although Stripe prohibits processing payments for adult content. Once Stripe was notified, AnyDream’s account was immediately terminated.[1]

4. Does AnyDream have issues generating content that features underage individuals?
Yes. Users of the AnyDream platform have expressed concerns over the display of pornographic content that appeared to involve underage girls. The company acknowledged initial challenges but has implemented measures to prevent the generation of such content.[1]

5. How many AI-generated pornographic content platforms are available?
There are dozens of platforms that have emerged in line with the development of AI, allowing users to create photorealistic images featuring various individuals without their consent.[1]

[1] Source: bellingcat.com