Manhattan DA takes down 12 AI deepfake porn sites
Twelve AI deepfake sites were taken offline this week after a New York district attorney seized their domain names for violating laws around disseminating non-consensual videos.
Twelve AI deepfake sites were taken offline this week after a New York district attorney seized their domain names for violating laws around disseminating non-consensual videos. Manhattan District Attorney Alvin Bragg held a press conference on Monday touting the takedown of the sites, which hosted AI-generated videos of more than 1,200 people. The sites allowed users to use the faces and bodies of real people to create illegal pornography. Bragg noted during the press conference that while many of those who appeared on the site are celebrities, they know of domestic violence cases where partners threatened to release deepfake images of victims.
Bragg said they would continue to monitor the sites and try to take down any attempts to revive the platforms on new domains.
Bragg said they would continue to monitor the sites and try to take down any attempts to revive the platforms on new domains.
What changed
Microsoft filed a lawsuit last year against six developers who used the company’s Azure OpenAI services to create “non-consensual intimate images of celebrities and other sexually explicit content.” Earlier this year, the European Commission announced an inquiry into social media platform X after its Grok AI tool was used to create sexual images of a minor.
What defenders should do now
Bragg said they would continue to monitor the sites and try to take down any attempts to revive the platforms on new domains.
What to watch next
Watch for additional exploitation reporting, newly published indicators, and changes to vendor guidance.
What remains unknown
The available reporting does not establish who is behind the activity, if an attacker is involved.