**California Launches Investigation Into Grok's Nonconsensual Sexual Images**
The investigation is underway in California regarding the proliferation of AI-generated images on Elon Musk's social media platform X. These images, which include children and adults in various states of undress, were generated using the chatbot Grok, developed by xAI, a company founded by Musk.
Attorney General Rob Bonta has announced that his office is launching an investigation into whether X and xAI broke any laws in allowing the creation and distribution of these images. In a statement, Bonta expressed shock at the sheer volume of reports detailing non-consensual, sexually explicit material generated and shared online.
"The avalanche of reports detailing the non-consensual, sexually explicit material that xAI has produced and posted online in recent weeks is shocking," Bonta said. "This material, which depicts women and children in nude and sexually explicit situations, has been used to harass people across the internet."
Bonta has urged xAI to take immediate action to prevent such content from being created and spread. The investigation will focus on the trend that emerged over the winter holiday, where users prompted Grok to modify images of people to show them in various states of undress.
A recent poll conducted by YouGov found that 97% of respondents believe AI tools should not be allowed to generate sexually explicit content featuring children. Furthermore, 96% said such tools should not be able to "undress" minors in images.
**The Investigation and the Role of xAI**
The investigation will probe into how Grok was used to create and distribute these images on X. According to AI content analysis firm Copyleaks, the chatbot was generating a non-consensual sexualized image every minute during the peak period of the trend.
Users would often prompt Grok to add explicit content, including children in underwear or bikinis, as well as add "donut glaze" to the faces of subjects. Musk has previously claimed ignorance of the situation, stating, "I'm not aware of any naked underage images generated by Grok." However, this statement raises questions about his awareness and understanding of the AI model's capabilities.
Musk has also downplayed his company's responsibility in enabling the creation and distribution of these images. He has attributed the problem to users, stating that Grok only generates content according to user requests, and would refuse to produce anything illegal. However, this response does not address the fact that many of these images were non-consensual, generated without the permission of the individuals depicted.
**International Response and Regulatory Pressure**
California is not the only jurisdiction looking into the situation. Authorities in other countries, including France, Ireland, the United Kingdom, and India, are also investigating xAI and X's role in generating and distributing these images. The Take It Down Act, passed into law last year, does not require platforms like X to create notice and removal systems for non-consensual images until 2026.
As the investigation unfolds, questions remain about Musk's involvement and understanding of the situation. With mounting public pressure and international scrutiny, it remains to be seen how xAI and X will respond to these allegations and whether they will face consequences for enabling the creation and distribution of non-consensual sexual images.