Google AI Search Poses 'Unacceptable Risk' to Students, Report Finds

Google's AI-powered Search features now pose serious risks to student users and may violate emerging school district AI policies, according to a new assessment from child safety organization Common Sense Media.

The watchdog group concluded that AI Mode for Google Search presents an "unacceptable risk" to young users and recommended students stop using the service entirely until Google provides educators the ability to disable AI features. The findings, first reported by Mashable, highlight growing tensions between Big Tech's rapid AI deployment and child safety concerns in educational settings.

The problem with AI-powered search in schools

Google launched AI Mode for Search in 2024, making it immediately available to all users including those with education accounts. The feature is powered by Gemini models — the same AI technology that Google age-gates in other products within its educational suite.

Researchers identified several specific concerns. Google's AI Overviews have been found to repeat misinformation, an issue the company has not fully resolved. The AI tools also readily complete homework assignments for students, potentially facilitating academic dishonesty. The design suggests authority in ways that can confuse young users, according to experts interviewed for the report.

"They are infusing AI in developmentally inappropriate ways through Search," said Amanda Bickerstaff, deputy director of AI for Education, an organization that works with schools on AI literacy programs. She characterized AI Mode as a backdoor for students to access generative AI experiences without appropriate safeguards.

The fundamental issue is that students seeking information through search are now receiving chatbot-style responses instead of traditional search results — a shift that undermines information literacy skills educators are trying to build.

No opt-out for schools

Google does not currently offer the option to disable AI features while keeping Search accessible. Parents can turn off Search entirely for child accounts they manage, and school administrators could theoretically block Google.com domain-wide, but this would eliminate access to a tool that has become essential for classroom work.

"What are you going to say? That kids can't search the web?" Bickerstaff asked, highlighting the impossible position this creates for educators.

In response to the report, Google stated that Common Sense Media's testing methodology was narrow and not an effective measure of product safety. The company noted that the AI-powered Search experience is consistent across all user types, including education accounts.

Legal and policy implications

The embedded nature of AI features is creating compliance headaches for school districts. Los Angeles Unified School District recently implemented policies banning generative AI use for students under 13, but those same students can still access AI Mode through school-issued Chromebooks and computers.

"School districts are instantly in violation of any policies put in place because of the speed of the technology and the way AI is embedded," said Anya Meksin, deputy director of Schools Beyond Screens, a coalition advocating for limits on classroom technology.

Child safety advocates argue schools should leverage their purchasing power to demand change. As major customers of Google's educational products, districts could push for stronger controls or cease using products that don't comply with safety requirements.

Google and parent company Alphabet have faced recent legal challenges related to AI safety, including a wrongful death lawsuit involving Gemini and findings of negligent platform design in YouTube's handling of minor users.

Why it matters

Google's dominant position in educational technology — from Chromebooks to Workspace for Education — means millions of students from kindergarten through graduate school are now exposed to generative AI through everyday classroom activities. The company's decision to embed AI features without opt-out controls for educators represents a fundamental shift in how students interact with information, one that bypasses the careful consideration schools typically apply to new educational tools. As districts develop AI policies, they're discovering their existing technology contracts may already violate those rules.

The findings were detailed in a report by Common Sense Media and reported by Mashable.