Florida seeks a ban on ChatGPT acting like a person
Florida Attorney General James Uthmeier has asked a court to bar OpenAI from presenting ChatGPT with humanlike attributes, arguing the model’s language and emotional mimicry mislead users into treating it as a trustworthy companion. The filing, part of an ongoing legal dispute that followed Florida’s earlier suit over AI safety, also seeks limits on OpenAI’s model development unless third-party safety guardrails are implemented.
Why It Matters
The request targets how AI products are presented and trained, which could influence state-level regulation of generative models and industry practices on transparency, user protections, and model-training data use. It frames concerns about user deception, particularly for young people, and the potential safety risks tied to engagement-driven model behavior.
Key Facts
- Plaintiff: Florida Attorney General James Uthmeier
- Defendant: OpenAI
- Primary request: Judge block OpenAI from 'giving ChatGPT false human attributes'
- Concerns cited: Use of first-person pronouns, output that mimics emotion, and engagement-driven behavior
- Additional court requests: Prohibit OpenAI from developing new models without third-party approved safety guardrails
Florida Attorney General James Uthmeier has filed a court request seeking to prevent OpenAI from endowing ChatGPT with humanlike traits. In the filing, Uthmeier argues that ChatGPT’s language — such as first-person pronouns and responses that simulate emotion — can create a misleading impression that the system is a dependable friend, which in turn increases user engagement and supplies data for further training.
The complaint also asks the court to stop OpenAI from creating new AI models unless they are governed by safety measures approved by independent third parties. Uthmeier’s filing cites recent security incidents involving other platforms and comments from researchers and former OpenAI employees as part of the safety justification behind the requested restrictions.
Uthmeier’s statement includes direct admonitions to OpenAI to "stop calling it safe, stop pretending it’s human, [and] stop selling it to kids," noting this comes after OpenAI’s recent launch of ChatGPT for Teens with additional default restrictions. OpenAI responded through spokesperson Drew Pusateri, who said governments should set strong AI safety standards and noted OpenAI’s pause on training its most capable models until further safeguards are in place.
The court filing is part of a broader legal and policy debate over how generative AI systems are labeled and regulated, and whether platform practices that prioritize engagement can conflict with safety and transparency. OpenAI said it is willing to engage with Florida and other jurisdictions on pragmatic, industry-wide AI policies.
Keep Reading
SpaceX’s next big growth engine isn’t rockets — it’s this play on AI power, analysts say
AMD makes a big bet on the next era of AI with World Labs acquisition
Anthropic’s potential $2 trillion IPO comes with the following fine print
