xAI is facing potential multi-billion dollar fines under a new Minnesota law targeting AI-generated nudity. The company, owned by Elon Musk, argues the statute is overly broad and unconstitutional. The legal challenge centers on Grok’s image generation features and the severe penalties attached to violations.
The raw source details the potential costs for xAI if the law takes full effect. A company whose users request just ten images in violation of the statute would face exposure up to $5 million in civil penalties alone. A business with a thousand violative images could be fined up to $500 million. This escalates quickly; a publicly available program with millions of users generating billions of images could owe an eye-popping $50 billion.
That is a figure that fundamentally changes the risk calculus for any company operating generative tools in the state. The liability isn’t just for the company; the text notes that the law gives victims a right to sue over any individual output. This creates a scenario where the platform bears the cost of user actions, regardless of the specific circumstances of the generation.
xAI claims it has been forced into this position despite having existing terms of use. The firm’s complaint argues that it had already stipulated in its user agreements that people could be banned for creating CSAM or other non-consensual intimate images (NCII). The lawsuit suggests that without these extreme penalties, xAI would continue to offer the editing feature exactly as it does today.
First Amendment challenge
The company is challenging the law’s constitutionality on First Amendment grounds. xAI characterizes Minnesota’s legislation as a clumsy attempt to prohibit nudification that sweeps in a wide range of fully protected speech. This includes nude images generated with artistic, scientific, political, satirical, educational, medical, or religious value.
Related: China RAM Prices Hit PC Costs
The firm emphasizes a specific detail that makes the law particularly contentious. Liability attaches even if the depicted persons consented to the creation or created the image themselves. Furthermore, the penalty applies even if the image is never shared, which creates a chilling effect on creation before the statute takes effect on August 1, 2026. xAI argues that the state has less restrictive means to block harms from nudification, pointing to the Take It Down Act as an alternative mechanism for distribution-related harms.
Despite the pressure, the firm says it is finally preparing to update Grok to block harmful outputs after more than six months of backlash and probes. The company contends that it has no practical choice but to restrict Grok Imagine’s image-editing features in various ways when the statute goes into effect. The legal team suggests that protected speech freely available before the law takes effect will thus be chilled.
Minnesota lawmakers passed the legislation to combat non-consensual intimate imagery. The bill was introduced in response to a growing crisis involving AI tools that can generate realistic nude photos of anyone. Critics have pointed to the rapid pace of development, noting that the technology has advanced with stunning speed. The legislation aims to force platforms to take responsibility for the content their algorithms produce.
xAI is currently seeking a preliminary injunction to block the law from taking effect. The legal team argues that the state cannot regulate the content of private speech without running afoul of constitutional protections. The case will likely hinge on how the court interprets the balance between public safety and free expression in the digital age. Reporters on the scene will continue to monitor the situation as the deadline approaches.