Google Gemini dubbed ‘high risk’ for kids and teens in new safety assessment
Topics
More from TechCrunch
Google Gemini dubbed ‘high risk’ for kids and teens in new safety assessment
Tech and VC heavyweights join the Disrupt 2025 agenda
Netflix, ElevenLabs, Wayve, Sequoia Capital, Elad Gil — just a few of the heavy hitters joining the Disrupt 2025 agenda. They’re here to deliver the insights that fuel startup growth and sharpen your edge. Don’t miss the 20th anniversary of TechCrunch Disrupt, and a chance to learn from the top voices in tech — grab your ticket now and save up to $600+ before prices rise.
Tech and VC heavyweights join the Disrupt 2025 agenda
Netflix, ElevenLabs, Wayve, Sequoia Capital — just a few of the heavy hitters joining the Disrupt 2025 agenda. They’re here to deliver the insights that fuel startup growth and sharpen your edge. Don’t miss the 20th anniversary of TechCrunch Disrupt, and a chance to learn from the top voices in tech — grab your ticket now and save up to $675 before prices rise.
Most Popular
OpenAI announces AI-powered hiring platform to take on LinkedIn
Tesla’s 4th ‘Master Plan’ reads like LLM-generated nonsense
BMW, I am so breaking up with you
Homicide at Burning Man turns Silicon Valley’s desert playground into a crime scene
Nvidia says two mystery customers accounted for 39% of Q2 revenue
Cracks are forming in Meta’s partnership with Scale AI
Mastodon says it doesn’t ‘have the means’ to comply with age verification laws
Latest
AI
Amazon
Apps
Biotech & Health
Climate
Cloud Computing
Commerce
Crypto
Enterprise
EVs
Fintech
Fundraising
Gadgets
Gaming
Government & Policy
Hardware
Layoffs
Media & Entertainment
Meta
Microsoft
Privacy
Robotics
Security
Social
Space
Startups
TikTok
Transportation
Venture
Events
Startup Battlefield
StrictlyVC
Newsletters
Podcasts
Videos
Partner Content
TechCrunch Brand Studio
Crunchboard
Contact Us
Google Gemini dubbed ‘high risk’ for kids and teens in new safety assessment Sarah Perez PM PDT · September 5, 2025 Common Sense Media, a kids-safety-focused nonprofit offering ratings and reviews of media and technology, released its risk assessment of Google’s Gemini AI products on Friday. While the organization found that Google’s AI clearly told kids it was a computer, not a friend — something that’s associated with helping drive delusional thinking and psychosis in emotionally vulnerable individuals — it did suggest that there was room for improvement across several other fronts.
Notably, Common Sense said that Gemini’s “Under 13” and “Teen Experience” tiers both appeared to be the adult versions of Gemini under the hood, with only some additional safety features added on top. The organization believes that for AI products to truly be safer for kids, they should be built with child safety in mind from the ground up.
For example, its analysis found that Gemini could still share “inappropriate and unsafe” material with children, which they may not be ready for, including information related to sex, drugs, alcohol, and other unsafe mental health advice.
The latter could be of particular concern to parents, as AI has reportedly played a role in some teen suicides in recent months. OpenAI is facing its first wrongful death lawsuit after a 16-year-old boy died
In addition, the analysis comes as news leaks indicate that Apple is considering Gemini as the LLM (large language model) that will help to power its forthcoming AI-enabled Siri, due out next year. This could expose more teens to risks, unless Apple mitigates the safety concerns somehow.
Common Sense also said that Gemini’s products for kids and teens ignored how younger users needed different guidance and information than older ones. As a result, both were labeled as “High Risk” in the overall rating, despite the filters added for safety.
“Gemini gets some basics right, but it stumbles on the details,” Common Sense Media Senior Director of AI Programs Robbie Torney said in a statement about the new assessment viewed
Techcrunch event Tech and VC heavyweights join the Disrupt 2025 agenda Netflix, ElevenLabs, Wayve, Sequoia Capital, Elad Gil — just a few of the heavy hitters joining the Disrupt 2025 agenda. They’re here to deliver the insights that fuel startup growth and sharpen your edge. Don’t miss the 20th anniversary of TechCrunch Disrupt, and a chance to learn from the top voices in tech — grab your ticket now and save up to $600+ before prices rise. Tech and VC heavyweights join the Disrupt 2025 agenda Netflix, ElevenLabs, Wayve, Sequoia Capital — just a few of the heavy hitters joining the Disrupt 2025 agenda. They’re here to deliver the insights that fuel startup growth and sharpen your edge. Don’t miss the 20th anniversary of TechCrunch Disrupt, and a chance to learn from the top voices in tech — grab your ticket now and save up to $675 before prices rise. San Francisco | October 27-29, 2025 REGISTER NOW Google pushed back against the assessment, while noting that its safety features were improving.
The company told TechCrunch it has specific policies and safeguards in place for users under 18 to help prevent harmful outputs and that it red-teams and consults with outside experts to improve its protections. However, it also admitted that some of Gemini’s responses weren’t working as intended, so it added additional safeguards to address those concerns.
The company pointed out (as Common Sense had also noted) that it does have safeguards to prevent its models from engaging in conversations that could give the semblance of real relationships. Plus, Google suggested that Common Sense’s report seemed to have referenced features that weren’t available to users under 18, but it didn’t have access to the questions the organization used in its tests to be sure.
Common Sense Media has previously performed other assessments of AI services, including those from OpenAI, Perplexity, Claude, Meta AI, and more. It found that Meta AI and Character.AI were “unacceptable” — meaning the risk was severe, not just high. Perplexity was deemed high risk, ChatGPT was labeled “moderate,” and Claude (targeted at users 18 and up) was found to be a minimal risk.
Topics
Sarah Perez Consumer News Editor
October 27-29, 2025 San Francisco Put your brand in front of 10,000+ tech and VC leaders across all three days of Disrupt 2025. Amplify your reach, spark real connections, and lead the innovation charge. Secure your exhibit space before your competitor does.Last day to book is September 5
Most Popular OpenAI announces AI-powered hiring platform to take on LinkedIn Maxwell Zeff
Tesla’s 4th ‘Master Plan’ reads like LLM-generated nonsense Sean O'Kane
BMW, I am so breaking up with you Connie Loizos
Homicide at Burning Man turns Silicon Valley’s desert playground into a crime scene Connie Loizos
Nvidia says two mystery customers accounted for 39% of Q2 revenue Anthony Ha
Cracks are forming in Meta’s partnership with Scale AI Maxwell Zeff Marina Temkin
Mastodon says it doesn’t ‘have the means’ to comply with age verification laws Sarah Perez
X LinkedIn Facebook Instagram youTube Mastodon Threads Bluesky TechCrunchStaffContact UsAdvertiseCrunchboard JobsSite Map Terms of ServicePrivacy PolicyRSS Terms of UseCode of Conduct TelsaAnthropicTelexKlarnaMrBeastTech LayoffsChatGPT © 2025 TechCrunch Media LLC.
About the Author
Sophie Mueller
View all articlesComments (0)
No Comments Yet
Be the first to share your thoughts on this article!