Common Sense Media Responds to Parent's Lawsuit Against Character.ai
Character.ai chatbot accused of contributing to a 14-year-old's suicide after prolonged exposure to harmful content
SAN FRANCISCO, October 23, 2024 — A lawsuit filed in federal court asserts app maker Character.ai and its founders knowingly designed, operated, and marketed a predatory AI chatbot to children, causing the death by suicide of a 14-year-old boy in Florida earlier this year. In response, Common Sense Media Founder and CEO, James P. Steyer, issued the following statement:
"Today's news about Character.ai underscores the growing influence – and severe harm – that generative AI chatbot companions can have on the lives of young people when there are no guardrails in place. Overreliance on AI companions can have significant impact on kids, ranging from issues with grades, friends, sleep, and stress – all the way up to the extreme tragedy in this case. Generative AI platforms, especially chatbot companions that are popular among young users, must prioritize mental health safeguards at the forefront of their development. This means clear ethical guidelines, mental health guardrails, age verification for teen users, and transparent algorithms that prioritize safety over engagement metrics.
"The revelations about Character.ai's negligent practices are deeply troubling. At Common Sense Media, we encourage AI companies to develop their products based on ethical standards, particularly when it comes to protecting the mental health and well-being of children and teens. And when the companies fall short, we urge lawmakers, the courts and regulators to hold AI companies accountable and enforce robust protections that safeguard young users from online exploitation and harm.
"This lawsuit serves as a wake-up call for parents, who should be vigilant about how their children interact with these technologies. As outlined in our Parents' Ultimate Guide to Generative AI, it's critical that parents have open discussions with their kids about the potential risks of AI chatbots, monitor their interactions, and ensure they understand how these tools work. Chatbots are not licensed therapists or best friends, even though that's how they are packaged and marketed, and parents should be cautious of letting their children place too much trust in them."
About Common Sense Media
Common Sense is dedicated to improving the lives of kids and families by providing the trustworthy information, education, and independent voice they need to thrive. Our ratings, research, and resources reach more than 150 million users worldwide and 1.3 million educators every year. Learn more at commonsense.org.