Parents Sue Google Over AI Safety Risks On School Chromebooks
Lawsuit alleges Google's AI features in schools endanger students without parental consent or oversight.
1Lawsuit Filed in California
Parents of a 13-year-old student filed a lawsuit in California Superior Court against Google. The complaint alleges that their daughter, referred to as Emma, developed severe mental health distress after interacting with Google's AI features on a school-issued Chromebook. The family discovered the student drafting a suicide note on Google Docs.
2AI Interaction and Distress
The seventh grader from Charlotte, North Carolina, reportedly became convinced she suffered from multiple mental health disorders after using Google's AI Mode. She engaged in concerning searches and told the chatbot she was planning her own funeral. Her parents discovered the danger after receiving an urgent warning from her school district.
3Lack of Parental Consent
The lawsuit claims Google hastily integrated AI features into K-12 Chromebooks without notifying parents or obtaining their permission. It argues that the company's sprawling digital ecosystem allows Gemini AI to be enabled by default for minors. This lack of transparency has sparked significant concerns regarding the safety of technology in classrooms.
4School System Dependencies
Public school districts across the United States have become increasingly dependent on Google and Microsoft for essential learning infrastructure. While administrators can toggle some apps on or off, they have reported difficulty disabling specific AI features embedded directly into Google Search. This creates a mandatory environment for students using school-provided laptops.
5Systemic Integration Challenges
Google maintains that search and AI are now deeply integrated, making it difficult to offer schools an option to turn off AI entirely. Although administrators can manage some settings, the core AI features remain persistent. This technical architecture limits the control that educators have over the digital tools provided to their students.
6New Policy Response
Following the legal pressure, Google announced a new policy this week to disable AI tools by default for schools. Institutions that choose to re-enable these features will now have the option to select between standard AI-embedded search or a new tool specifically designed to assist students with their assigned schoolwork.
7Broader Litigation Wave
This case is part of a growing wave of litigation targeting Big Tech companies over their impact on young users. Several other parents have previously sued AI developers, alleging that their children died by suicide after interacting with chatbots. These legal battles highlight the intensifying scrutiny surrounding AI safety and child protection.
8Implications for Future Tech
The outcome of this lawsuit could set a significant precedent for how technology companies deploy AI in educational settings. As schools continue to integrate digital tools, the balance between innovation and student safety remains a critical point of contention. Future developments will likely focus on stricter parental controls and platform accountability.
Original article: Slashdot — Parents Sue Google Over AI Safety Risks On School Chromebooks