AI Chatbots in Schools: A Call for Proactive Safety and Policy

The EdSafe AI Alliance has released a comprehensive guide addressing the critical role of AI chatbots in schools and the pressing safety, legal, and policy challenges they bring. As of 2024–2025, 85% of teachers and 86% of students report using AI in classrooms, with 42% of students engaging with chatbots for mental health support or companionship. Alarmingly, 31% do so on school-issued devices, with some even disclosing personal trauma or suicidal thoughts.

The report warns that schools could face legal liability under "foreseeable harm" if they fail to act on disclosures made to AI systems. Chatbots are not mandated reporters, yet schools that provide access to them are still responsible for student safety.

To address this, EdSafe AI proposes a 4-step safety protocol:

1. FLAG potential risks via technical monitoring tools.

2. NOTIFY responsible personnel immediately.

3. ASSESS each flagged case with human oversight to filter false positives.

4. ACT by following existing mandated reporting protocols.

The guide also outlines compliance with FERPA and COPPA, recommends updates to Acceptable Use Policies (AUPs), and calls for transparency with students and parents. Schools must shift from reactive to proactive policies—integrating safeguards, legal review, and education around responsible AI use.

Source: www.edsafeai.org

Infographic: NotebookLM