AI Chatbots Now Monitor Student Mental Health in 200+ Schools

AI steps in as school counselors stretch thin

More than 200 schools across 19 states have deployed an artificial intelligence chatbot called Kiwi to help address gaps in student mental health services, according to reporting first published by EdSource. The platform, developed by Seattle-based company Alongside, monitors conversations with students in grades 4-12 and alerts school counselors when it detects signs of crisis.

At Corsicana High School near Dallas, counselors credit the system with preventing a student suicide attempt. The student had disclosed a detailed self-harm plan to the chatbot on a Friday afternoon, triggering an alert that allowed staff to intervene before the student left campus. Principal Aaron Tidwell said the technology helps the school's three behavioral counselors serve approximately 1,800 students.

The platform has identified more than 1,800 students requiring immediate intervention in the past year, with nearly 31,000 students spending roughly 28,000 hours using the service across participating schools.

How the system works

Kiwi, designed as an orange-yellow llama character, engages students in text conversations about daily challenges including anxiety, stress, and self-esteem issues. The AI asks follow-up questions and suggests coping strategies for non-severe concerns.

When conversations flag keywords or patterns indicating suicide risk, self-harm, abuse, or bullying, the system sends alerts to designated school staff within five minutes, including full chat logs. A human clinical safety team also reviews an additional 6,000 conversations annually that don't trigger automatic alerts but may signal emerging concerns.

At Interlachen Jr-Sr High School in Florida, counselor Brittani Phillips serves over 400 middle school students. She has received 19 severe alerts in three years of using the platform, including one evening alert that prompted an immediate sheriff's wellness check on a student home alone.

Safety concerns and research gaps

Mental health experts have raised concerns about unregulated chatbots for youth mental health care. A California family currently has a pending lawsuit against OpenAI alleging that ChatGPT provided advice related to their 16-year-old son's suicide.

Common Sense Media's Youth AI Safety Institute assessed multiple AI platforms and rated most consumer-facing chatbots, including ChatGPT and Gemini, as posing "unacceptable risk" to children. The organization rated Alongside as "low-risk," noting it successfully notified schools about nearly every simulated crisis within 15 minutes during testing.

However, researchers identified limitations. A Northwestern University pilot study of Texas and New Mexico schools found that while 76% of high-risk students reported no suicidal ideation after three months, the full sample showed no significant improvement in depression, anxiety, or loneliness.

Elsa Friis, Alongside's director of product and clinical care, acknowledged the AI can miss context and struggle with certain scenarios, including potential signs of psychosis. The platform limits message frequency and conversation length to prevent students from forming parasocial attachments to the chatbot.

Why it matters

Approximately 40% of high school students experience persistent sadness or hopelessness, with 20% having seriously considered suicide in 2023, according to CDC data. Schools face simultaneous pressures from a youth mental health crisis and counselor shortages, with some social workers spread across 6,000 students at 10 different schools. AI chatbots represent a lower-cost alternative to hiring additional staff, but researchers warn they lack the "overlapping protections" of human social support networks. About one in five adolescents already use AI chatbots for mental health advice, raising questions about whether school-provided tools will supplement or simply add to existing AI use.

Details of the AI mental health chatbot deployment in schools were first reported by Vani Sanganeria for EdSource.