Washington: The move comes as the parents of 16-year-old Adam Raine filed a lawsuit against OpenAI and CEO Sam Altman, alleging that ChatGPT “systematically isolated” their son and played a role in his death by hanging in April. The case adds to growing concerns about the risks of heavy chatbot use, particularly among minors.
In a blog post Tuesday, OpenAI said ChatGPT will soon be updated to better recognize when users express distress in different ways, for instance, warning about the dangers of sleep deprivation or encouraging rest if someone says they feel “invincible” after two sleepless nights. The company admitted that its current safeguards work best in short chats and can break down during prolonged conversations.
OpenAI also announced parental controls to let families monitor and manage how children use ChatGPT, alongside improvements to prevent sensitive content from slipping through. The company is exploring clickable links to emergency services within the chatbot, and even the possibility of connecting users directly with licensed professionals in times of crisis.
“We extend our deepest sympathies to the Raine family during this difficult time and are reviewing the filing,” an OpenAI spokesperson said.
The lawsuit comes amid mounting scrutiny of AI companies. More than 40 U.S. state attorneys general issued a warning this week, reminding firms of their legal duty to protect children from harmful chatbot interactions. Meanwhile, mental health advocates have flagged concerns about users developing dependency, delusions, or engaging in unsafe behaviors with AI companions.
Since launching in late 2022, ChatGPT has surged to more than 700 million weekly users worldwide. While widely used for education, coding, and entertainment, its growing role as a pseudo-therapist has raised alarms. OpenAI says it is working to improve ChatGPT’s resilience in extended conversations and ensure earlier intervention when users show signs of crisis.
For Adam Raine’s parents, the updates come too late. Their attorney, Jay Edelson, welcomed the company’s acknowledgement but questioned its timing: “Where have they been over the last few months?”