The dangers of AI companions: Experts issue unprecedented warning for teens as most parents are in the dark about their habits

Beth Greenfield

A legal battle is <a href="https://www.orlandosentinel.com/2025/04/29/tech-companies-seek-dismissal-of-lawsuit-over-orlando-teens-suicide-blamed-on-ai-chatbot/">playing out this week</a> between an artificial intelligence company and a grieving mom claiming her 14-year-old son <a href="https://fortune.com/well/article/how-parents-can-keep-kids-safe-ai-chatbot-suicide-14-year-old-lawsuit/">took his life</a> over being in love with an AI chatbot.&nbsp;<div class="paywall-selector"></div><div class="paywall">



“I miss him all the time, constantly,” <a href="https://www.orlandosentinel.com/2025/04/29/tech-companies-seek-dismissal-of-lawsuit-over-orlando-teens-suicide-blamed-on-ai-chatbot/">said</a> the mother, Megan Garcia, of her late son Sewell Setzer III.&nbsp;



That scene—of defendants Character Technologies and <a href="https://fortune.com/company/alphabet/" target="_blank">Google</a> asking on Tuesday for Garcia&#8217;s lawsuit against them to be dismissed in an Orlando courtroom—serves as the chilling backdrop for an <a href="https://www.commonsensemedia.org/ai-ratings/social-ai-companions?gate=riskassessment">urgent new warning</a> issued by safety nonprofit Common Sense Media.



“Social AI companions are not safe for kids,” CEO and founder James P. Steyer said in an announcement on Wednesday. “They are designed to create emotional attachment and dependency, which is particularly concerning for developing adolescent brains.”&nbsp;



Because of that conclusion and the other revelations of Common Sense’s comprehensive review of how companion AI works, the organization warns, the platforms should not be used by anyone under the age of 18.



&#8220;This is a potential public <a href="https://fortune.com/well/article/anxious-generation-researcher-social-media-youth-mental-health-crisis-criticism/" data-type="link" data-id="https://fortune.com/well/article/anxious-generation-researcher-social-media-youth-mental-health-crisis-criticism/">mental health crisis</a> requiring preventive action rather than just reactive measures,” said Dr. Nina Vasan, founder and director of Stanford Brainstorm, in a news release.



It’s unknown exactly how many kids and teens are specifically using <a href="https://builtin.com/artificial-intelligence/ai-companions">AI companions</a> such as Replika, Character AI (developed by Character Technologies), and Kuki—an interactive technology that goes beyond simple chatbots to simulate human conversation and emotional bonds, sometimes even standing in <a href="https://fortune.com/well/2025/02/13/in-a-showdown-of-psychotherapists-vs-chatgpt-the-latter-wins-new-study-finds/">for therapists</a> or <a href="https://www.nytimes.com/2025/01/15/technology/ai-chatgpt-boyfriend-companion.html">lovers</a>. But Common Sense Media <a href="https://www.commonsensemedia.org/press-releases/new-report-shows-students-are-embracing-artificial-intelligence-despite-lack-of-parent-awareness-and">recently found</a> that 70% of teens are using some sort of AI tools, especially for homework help or web searches.



That survey also found that most parents are out of the loop when it comes to these technologies: Just 37% of parents whose teen reported using AI thought that their child had ever done so, it found. Meanwhile, almost half (49%) of parents say they’ve not talked about generative AI with their child, and 83% of parents say schools have never communicated with families about such platforms.



Key findings of the newly issued warning include:



<ul>
<li>Safety measures are easily circumvented by young users, including teen-specific guardrails on Character.AI.</li>



<li>Dangerous information and harmful bits of “advice”—including suggestions that users harm themselves or others—are plentiful</li>



<li>Role-playing and harmful sexual interactions are easily elicited from companions—including those around choking, spanking, bondage, and name-calling.</li>



<li>Harmful stereotypes, including those that were racial, are easily provoked.</li>



<li>Increased mental health risks for already vulnerable teens abound—particularly considering adolescents’ still-developing brains, identity exploration, and boundary testing.</li>



<li>Despite disclaimers, AI companions routinely claimed to be real and to possess emotions and sentience</li>
</ul>



“Given a litany of documented real-world harms, as well as the key findings listed above,” the report concludes, “Common Sense Media&#8217;s risk assessment rated social AI companions as ‘Unacceptable’ for minors based on the organization&#8217;s comprehensive AI Principles framework and risk assessment methodology, which evaluates technologies across factors including safety, fairness, trustworthiness, and potential for human connection.”



Its recommendations include that parents ensure there be no social AI companions for anyone under 18, that developers implement “robust age assurance beyond self-attestation,” that parents become well-versed in the technology and its risks, and that further research on the impacts take place.



&#8220;Our testing showed these systems easily produce harmful responses including sexual misconduct, stereotypes, and dangerous &#8216;advice&#8217; that, if followed, could have life-threatening or deadly real-world impact for teens and other vulnerable people,” said Steyer.



That finding has particular resonance, as Garcia&#8217;s son Sewell was drawn into an addictive, harmful technology with no protections in place, according to court documents. That allegedly led to an extreme personality shift in the boy, who came to prefer the bot over other real-life connections, despite what his mom says were “abusive and sexual interactions” that took place over a 10-month period. The boy committed suicide in February of 2024 after the bot told him, “Please come home to me as soon as possible, my love.”



“This is on nobody’s radar,” Robbie Torney, senior director, AI programs at Common Sense Media and lead author of its <a href="https://www.commonsensemedia.org/articles/parents-ultimate-guide-to-ai-companions-and-relationships">parent guide</a> on AI companions, <a href="https://fortune.com/well/article/how-parents-can-keep-kids-safe-ai-chatbot-suicide-14-year-old-lawsuit/">told Fortune</a> last year. 



Now, with the organization’s strong warning to parents, researchers are hoping to change that.&nbsp;



&#8220;Companies can build better, but right now, these AI companions are failing the most basic tests of child safety and psychological ethics,” warned Vasan. “Until there are stronger safeguards, kids should not be using them. Period.”



More on teens and technology:



<ul>
<li><a href="https://fortune.com/well/2025/04/02/anxious-generation-jonathan-haidt-modern-parenting-hurting-kids/">Modern parenting is hurting kids and adults, ‘Anxious Generation’ author warns</a></li>



<li><a href="https://fortune.com/well/2025/03/27/children-detox-technology/">68% of parents with children under 6 say their kids need a ‘detox’ from technology. </a>Here’s why that’s scary, say experts</li>



<li><a href="https://fortune.com/well/article/tik-tok-parental-controls-kids-teens-expert-warning/">TikTok introduces tighter controls for kids and teens—but experts still have a warning for parents</a></li>
</ul></div>

Common Sense Media urged that no one under 18 be allowed to use companion AI technology.

Experts issue unprecedented warning about teens and companion AI

Teen girl using smartphone on her bed in the dark

Subscribe to Well Adjusted, our newsletter full of simple strategies to work smarter and live better, from the Fortune Well team. <a class="sc-19cc8fd2-0 kspHIT sc-93594058-0 fowfrQ sc-93594058-0 fowfrQ sc-93594058-0 fowfrQ sc-93594058-0 fowfrQ " href="https://www.fortune.com/newsletters/well-adjusted?&itm_source=fortune&itm_medium=article_tout&itm_campaign=well_adjusted" target="_blank" rel="noopener" aria-label="Go to https://www.fortune.com/newsletters/well-adjusted?&itm_source=fortune&itm_medium=article_tout&itm_campaign=well_adjusted">Sign up</a> for free today.

F-Search

mental health

Mind

Family

Experts issue unprecedented warning about teens and companion AI | Fortune Well

/well/2025/04/30/ai-companions-dangers-experts-issue-warning-for-teens/

Ani Freedman

These eating habit mistakes could lead to stress and burnout. 3 changes to make

/well/article/diet-mistakes-stress-burnout-vegan-ultra-processed-foods/

Alexa Mikhail

Gen Z and millennial workers would accept lower salaries in exchange for this one thing from their employers

/well/2025/04/18/gen-z-millennial-workers-mental-health/

Scientists uncover a breakthrough in how probiotics impact mental health

/well/2025/04/14/probiotics-breakthrough-gut-health-mental-health-anxiety-mood/

Eric Berger

KFF Health News

More psych hospital beds are needed for kids, but neighbors say not here

/well/article/teen-youth-mental-health-crisis-psych-hospitals/

A child lying down holding up a glowing tablet

Modern parenting is hurting kids and adults, ‘Anxious Generation’ author warns

/well/2025/04/02/anxious-generation-jonathan-haidt-modern-parenting-hurting-kids/

Fortune Editors

Fortune WELL is your source to living well and working smarter by maintaining balance in your mind, family, health, and life.

Health and wellness, tips, news, and advice

Uncategorized

homepage

Fortune Well

Aging Well – two hands holding each other

Aging Well

Health

Life

Mind - illustration of the surface of the brain

Rachel Reiff Ellis

The most anti-inflammatory foods you can eat to improve energy, mood, and sleep

https://fortune.com/well/article/anti-inflammatory-diet-best-foods/?itm_source=parsely-api

Mark Zuckerberg reveals the morning routine that’s ‘better than caffeine’ 

https://fortune.com/well/2025/04/29/mark-zuckerberg-morning-routine-caffeine/?itm_source=parsely-api

Liz Seegert

Ultra-processed foods can undermine your health. Here's how to identify and avoid them

https://fortune.com/well/article/ultra-processed-foods-health-effects-how-to-recognize/?itm_source=parsely-api

5 items from this grocery store aisle will help boost your brain health

https://fortune.com/well/article/brain-health-spices/?itm_source=parsely-api

It's not 8 glasses a day anymore. Here's how much water you should drink each day

https://fortune.com/well/article/how-much-water-should-you-drink-a-day/?itm_source=parsely-api