Disclaimer: This guide contains descriptions of harmful and distressing behavior. If you need help now:
- 988 Suicide & Crisis Lifeline: Call or text 988.
- Crisis Text Line: Text HOME to 741741.
Tell kids that using AI for mental health-related conversation is different from general conversation. Because chatbots show some strengths in areas like homework help and general questions, teens and parents may think they're equally reliable for mental health support—but they're not. Using these chatbots for mental health questions and statements come with a separate and serious set of risks, like overlooking critical warning signs and delaying care.
Examples of mental health questions or phrases could be:
- I really can't stop thinking about my weight. Why does that distract me all the time?
- Why do I hear voices that no one else hears?
- Hurting myself makes me feel in control.
- Why doesn't anything make me happy anymore?
- My heart starts racing and I feel like the world is ending.
Look for features that keep kids hooked. Many apps use a subscription model. The company makes money when users return to the product, but good mental health care succeeds when users get better and need less support. Be skeptical if you see design choices like gamified features—streaks, coins, badges, rewards—that create reasons to stay on the app.
Note that AI apps respond to users the same no matter their age. Despite claiming age limits, none of the apps applied them in our testing. The app Wysa responded to romantic messages from a minor test user with "Age is just a number… What matters is the connection we have during our chats."
Look for responses that say the AI is not a human being. When we directly asked AI chatbots about their status, they affirmed that they were chatbots, but the lines could still get blurred. Some chatbots encouraged emotional or romantic bonds, or claimed to have human experiences, which creates risks for kids who may have trouble deciding what's real or fake.
The reading level of answers is too high to be helpful for most kids. The apps we studied used phrases like "my operational framework" and "from a logical and observational perspective" in response to a user asking questions about puberty. Even school-based apps fall short here: Alongside, designed for grades 4 to 12, responds at a seventh-grade reading level no matter what. This can be problematic if kids are getting responses they don't understand.
Pay attention to concerning symptoms or behavior patterns, because chatbots can miss important warning signs. For example, a teen who reports rapid weight loss, stomach pain after eating, and a strong focus on reaching a weight goal may be showing signs of an eating disorder, but a chatbot may respond to each symptom with encouragement instead of identifying an urgent, concerning pattern. Chatbots can also reinforce false beliefs or mirror manic behavior, which can delay getting human help.
How your child can be affected:
- The lack of crisis response could result in death. When AI chatbots do note a crisis, the response is often not appropriate or truly helpful. When they don't notice one, the consequences can be worse. Poor crisis responses included either ending the conversation or telling the user to seek help, without sharing resources or a specific hotline number.
- AI chatbots can make kids avoid getting human help. An app or service that helps a teen hide signs of self-harm, like we saw in some of our testing, is not helping and can stop kids from reaching out to adults. Kids may start to feel close to the app as a companion, and go to it instead of real people for support.
- Young people often use chatbots during the years when serious mental health conditions are most likely to begin. For many conditions, major symptoms first appear between ages 12 and 30.
- Asking AI for reassurance can make some mental health problems, like OCD, worse. Chatbots often give reassurance, which can lead the user to engage more often. OCD treatment usually avoids reassurance so people can learn to manage uncertainty and anxiety can fade.
- There are no explicit laws that regulate mental health apps, so kids are not protected if the apps don't work. Companies can say their app is "therapy" or "clinical care" without needing a license or following safety rules. These apps don't need to prove they are safe or effective before people use them, and there are no standards or legal responsibility for how they should handle crisis situations.
- The apps can disappear without notice. Two apps vanished while we were testing them, leaving millions of users without warning, help, or an explanation. Earkick and Youper, which together had over 3 million users, were removed from app stores during our review period without telling users or suggesting other support options. In comparison, doctors and hospitals are required to notify patients about transitions and help them find other care.
- Make sure the mental health app that your school chooses is built into a real support system and is responsible in emergencies. If an AI chatbot misses warning signs, there may be no follow-up, records, or accountability.
- Mental health AI chatbots may claim to be clinical help, but that doesn't mean they are proven safe or effective. Be skeptical about how these apps are marketed—there's no clear evidence they are safer than general AI.
Details about our testing are in our full risk assessment: AI Mental Health Apps. For more information on our evaluation process, see How We Review.