Security
AI Gun Detector Mistook Doritos for Weapon, Lawsuit Claims
Four Baltimore students say they were handcuffed after an AI system falsely flagged chips as a firearm with 90% confidence.
Key takeaways
- Four Baltimore students were handcuffed at gunpoint after an Omnilert AI weapon detector flagged a Doritos bag as a firearm with 90% confidence.
- School staff canceled the alert after determining it was false, but a communication breakdown led to an armed police response anyway.
- A Maryland inspector general investigation found human error and training gaps, not system bias, caused the escalation.
- The lawsuit seeks mandatory verification protocols before AI threat alerts trigger armed police responses in schools.
- Legal advocates argue the case demonstrates the need for greater oversight and transparency in deploying AI security systems.
Four students have filed suit against Baltimore County Public Schools, local police, and AI security firm Omnilert, alleging they were detained at gunpoint after an artificial intelligence weapon detection system misidentified a bag of chips as a firearm.
The lawsuit, filed November 17 in Baltimore County Circuit Court, stems from an October 20, 2025 incident outside Kenwood High School. According to the complaint, the students—all Black teenagers waiting for a ride after football practice—were suddenly surrounded by officers with drawn weapons, forced to their knees on concrete, handcuffed, and searched. The threat turned out to be a bag of Cool Ranch Doritos.
Why it matters
The case highlights critical questions about deploying AI-powered security systems in schools without adequate verification protocols. When automated threat detection generates false positives with high confidence scores, the consequences for students can be severe—particularly when communication breakdowns prevent cancellation notices from reaching responding officers. The incident underscores the need for human oversight layers before armed police responses are triggered.
How the Alert Escalated
Attorneys representing the students said Omnilert's system issued an alert indicating a 90% probability that a gun was present on campus. School and police personnel quickly reviewed the alert and determined it was invalid, then canceled it, according to the complaint.
Despite the cancellation, an armed police response was still dispatched due to failures in communication and notification procedures, the lawsuit alleges. The students' legal team—comprising the Lawyers' Committee for Civil Rights Under Law, Willkie Farr & Gallagher LLP, and Engel Law Group—argues this represents a violation of the students' constitutional rights.
"The police told my son this could have been a real problem," said Freida Winfield, who was on her way to pick up the students when the incident occurred. "No child in Baltimore County should face this kind of danger while waiting outside his own school for a ride home from his mother."
Investigation Found Human Error
The Maryland Office of the Inspector General for Education previously investigated the incident and issued a report in November 2025. That review found a school employee failed to notice the cancellation notice and shared a screenshot of the original alert with a law enforcement officer, triggering the police response.
The inspector general's report concluded the incident resulted from "human error and training gaps" rather than system bias or ineffectiveness. The agency noted the alert was triggered by the student's position, hand movements, and reflective properties of an object in the image—not by specifically identifying a chip bag as a gun.
Calls for Reform
The plaintiffs are seeking reforms requiring schools and police to verify AI threat-detection reports before dispatching armed responses. They also want policies mandating greater training, oversight, and transparency around the technology's deployment.
"These students were failed not only by a technology that is prone to false alerts, but also by the very adults meant to keep them safe when we send them to school," said Damon Hewitt, president and executive director of the Lawyers' Committee for Civil Rights Under Law.
The Baltimore County Police Department declined to comment on pending litigation. USA TODAY first reported the details of the lawsuit.