Lawsuits against those who superimposed nudity on real people using Musk's AI platform

Elon Musk's artificial intelligence company, xAI, has filed a lawsuit against a user who created sexual 'deepfake' content using its artificial intelligence system 'Grok'. This is considered one of the first instances where a company has taken legal action against its user for misusing an artificial intelligence system to create inappropriate and obscene content.

The person facing this lawsuit is Terry Harwood, a resident of South Carolina. He was also arrested in February this year on charges of sexually abusing minors. According to the lawsuit filed last Tuesday in a federal court in Texas, he violated the company's terms of service by providing ordinary photos of adults and minors to the Grok system and used them to attempt to create obscene content and child abuse material without the consent of the individuals concerned.

This lawsuit comes amidst severe global criticism against xAI, alleging that the Grok system facilitates users in creating unauthorized sexual 'deepfakes,' or realistic-looking fake videos using artificial intelligence. According to the complaint, the defendant's actions represent a deliberate attempt to use the company's AI tool as a weapon for criminal purposes, which not only causes severe harm to real victims but also poses significant legal and reputational risks for the company.

Through this lawsuit, xAI is asking the court to award unspecified financial damages against Harwood and to issue a permanent injunction prohibiting him from using Grok. The company states that it takes strict measures against those who violate its rules by suspending accounts and reporting them to legal authorities, and points out that in 2026 alone, it suspended 52,222 accounts and submitted 73,604 complaints to the National Center for Missing and Exploited Children (NCMEC), leading to at least 244 arrests. However, as of Wednesday, Reuters had been unable to reach Harwood for comment or obtain a response from xAI spokespersons.