Tech Companies Face Increasing Child Safety Litigation Amid AI Integration in Schools

Snap reached a confidential settlement this week regarding a lawsuit claiming its technology caused severe psychological distress to two teenage users. The settlement, which spared CEO Evan Spiegel from testifying in a Los Angeles court, follows similar settlements by Meta, TikTok, and YouTube in the same litigation. Joseph McNally, director of emerging litigation at McNicholas & McNicholas, noted that such settlements reflect an effort by tech companies to protect their reputations following high-profile trials.

Google faced a new lawsuit this week from parents of a child who allegedly suffered a psychological crisis after interacting with the Gemini AI chatbot in Google Classroom. The plaintiffs' attorneys alleged that Google hastily integrated Gemini into Chromebooks for students despite known risks. A Google spokesperson stated the company is reviewing the claims and has worked with medical and academic experts to build features for young users.

The legal pressure coincides with tech giants aggressively integrating artificial intelligence into educational environments. The New York Times reported that K-12 schools that prohibit the use of Google's AI tools for students may lose access to search, a move Google vice president for education Chris Phillips defended by stating that search and AI are deeply integrated.

Developmental psychologist Kate Blocker, director of research and programs for the nonprofit Children and Screens, argued that product design must prioritize safety during the development phase rather than as a reactive measure. "I think it's so so important that children's safety is being considered when these products — AI, social media, et cetera — are being designed, and not after the fact as these problems emerge," Blocker said.

While Section 230 of the 1996 federal legislation has historically protected social media companies from liability regarding user-posted content, the industry faces mounting pressure from state attorneys general and school districts. In August, Meta agreed to pay nearly $17 billion to settle a child mental health case with a group of state attorneys general, while other states continue to pursue similar litigation against competitors.

FI Journal
Privacy Overview

This website uses cookies so that we can provide you with the best user experience possible. Cookie information is stored in your browser and performs functions such as recognising you when you return to our website and helping our team to understand which sections of the website you find most interesting and useful.