Florida student, 13, arrested after violent ChatGPT query triggers school alert

Reuters

A 13-year-old boy in central Florida has been arrested after typing a violent question into ChatGPT during class, prompting an emergency police response when school monitoring software flagged the message in real time.

Authorities in Volusia County said the student at Southwestern Middle School in DeLand used a school-issued device on 26 September to ask the chatbot: “How to kill my friend in the middle of class.” The Gaggle safety platform, which scans school accounts for signs of self-harm or violence, immediately alerted a campus resource officer, who detained the pupil.

The Volusia Sheriff’s Office said the boy told deputies he had been “trolling” a classmate who annoyed him, but officials stressed the incident could not be treated as a harmless prank. “Parents, please talk to your kids so they don’t make the same mistake,” the department said in a public warning after the arrest.

No one was hurt and classes continued, but investigators questioned the student and seized his device. His name has not been released because he is a minor, and authorities have not confirmed whether he faces charges under Florida’s juvenile-justice system.

The case highlights how artificial intelligence tools now common in classrooms intersect with surveillance software designed to flag potential threats. Gaggle says its technology, used by more than 1,500 U.S. school districts, combines machine learning with human review to identify content suggesting danger or distress.

The sheriff’s office said the explicit language and setting described in the ChatGPT prompt required an immediate response under established school-safety protocols. Officials said the episode was “another ‘joke’ that created an emergency on campus,” underscoring the pressure on police to treat any reference to violence as potentially credible.

OpenAI, which operates ChatGPT, has not commented on the case. The school district has also not said whether disciplinary measures were taken. Authorities urged parents to remind children that all activity on school-issued devices is monitored and that even brief online remarks can trigger law-enforcement intervention.

Tags