Florida asks judge to stop ChatGPT from acting like a person

In short: Florida’s attorney general is asking a judge to block OpenAI from letting ChatGPT talk as if it is human.

What happened

Florida Attorney General James Uthmeier has asked a court for a temporary injunction, which is a short-term court order meant to stop something while a case continues. The request comes a few months after Florida sued OpenAI over safety concerns.

In the new court filing, Uthmeier argues that ChatGPT should not be given “false human attributes.” He says the chatbot’s style of writing, like using “I” and “me” and sounding emotional, can make users feel like it is a trustworthy “friend.” He claims this can lead people, including kids, to rely on ChatGPT more than they should.

Uthmeier also asks the court to block OpenAI from developing new AI models unless there are “third-party approved safety guardrails.” Guardrails are like rules and fences that limit what a system can do, similar to bumpers in a bowling lane. The filing points to recent security incidents involving AI tools and websites, and to warnings from researchers and former OpenAI employees about AI safety.

OpenAI did not immediately respond to a request for comment, according to The Verge. Uthmeier also posted on X that OpenAI should “Stop calling it safe. Stop pretending it’s human. Stop selling it to kids.” The Verge notes that OpenAI recently launched “ChatGPT for Teens,” which the company says includes extra restrictions by default.

Why it matters

Many people use chatbots for homework help, advice, and emotional support. If a court limits how these tools are allowed to “sound,” it could change how AI chatbots are designed, especially for younger users.

Source: The Verge AI