Google AI Search Features Fail Child Safety Tests

Google's AI-powered search features have failed child safety evaluations conducted by Common Sense Media, raising concerns about the technology's deployment on devices used by young people.

The nonprofit media watchdog organization determined that Google Search's AI Overviews and AI Mode present an "unacceptable risk" to children, according to findings detailed in a new report.

Why it matters

Google Search serves as the default search engine on countless personal and school-issued devices used by children daily. Unlike optional features that can be disabled, the AI-generated answers appear automatically in search results with no way for parents, educators, or administrators to turn them off. This creates a mandatory exposure scenario for young users who may encounter inappropriate or inaccurate AI-generated content.

The scope of the problem

The evaluation examined two specific Google AI search products: AI Overviews, which provide AI-generated summaries at the top of search results, and AI Mode, a more conversational search experience powered by artificial intelligence.

Both features have become standard components of the Google Search experience, appearing by default when users conduct searches. For children using school-issued Chromebooks or personal devices with Google as their primary search engine, there is no mechanism to opt out of these AI-generated responses.

Implications for schools and families

The Common Sense Media assessment arrives as educational institutions increasingly rely on Google's ecosystem for digital learning. Many school districts have standardized on Google Workspace and Chrome devices, making Google Search the primary gateway to online information for students.

The inability to disable AI features creates a policy challenge for schools attempting to control the digital environments their students access. Parents similarly lack tools to prevent their children from encountering AI-generated search content on home devices.

The specific nature of the risks identified by Common Sense Media was not detailed in the available information, though the organization's use of the term "unacceptable risk" suggests serious concerns about content appropriateness, accuracy, or other child safety factors.

These findings were first reported by Axios, which obtained details of the Common Sense Media report examining Google's AI search capabilities and their impact on young users.