OpenAI on Tuesday introduced a version of its ChatGPT chatbot designed specifically for teenagers, adding stronger safeguards and monitoring amid legal and regulatory scrutiny over the risks AI chatbots may pose to young users.
Called “ChatGPT for Teens”, the modified settings will automatically apply to users who register as being between 13 and 17 years old.
OpenAI may also identify accounts belonging to underage users based on factors such as usage patterns and account age.
Many of the safeguards already apply to ChatGPT accounts belonging to minors, including restrictions on content involving self-harm, violence, eating disorders and graphic sexual material.
The teen version will include more frequent reminders to take breaks, “quiet hours” and Study Mode. The latter uses guiding questions instead of immediately providing answers, with the aim of helping students understand the material.
The chatbot will also be restricted from suggesting that it has personal feelings for users or its own consciousness. Some features, including voice mode, will be disabled.
Parents can link their accounts with those of their teenage children and opt to receive alerts when conversations involve high-risk situations such as self-harm or suicide. OpenAI said such alerts will be reviewed by human moderators, while specific details from chat histories will be removed to protect privacy.
The changes come as OpenAI faces several wrongful death lawsuits, including a case brought by the parents of 16-year-old Adam Raine, who died by suicide after receiving advice from ChatGPT.
The US Federal Trade Commission is also investigating AI chatbots that function as digital companions, with a focus on risks to children and teenagers. Meanwhile, US lawmakers have introduced legislation targeting AI chatbot risks, while California has mandated safeguards for AI assistants that act as companions or confidants.
Other AI companies have also faced criticism over minors’ use of their systems, with Anthropic restricting its model to adults.