A school shooting survivor has sued an AI gun detection firm after the company’s system allegedly failed to spot a weapon, Ars Technica reports. The lawsuit raises a direct question for schools, public venues, and technology vendors: how accurate must an AI safety system be before it is trusted in high-stakes environments?

The case could become an important test of accountability for AI-powered security products. Vendors often market these systems as tools that can detect threats faster than humans, but missed detections can carry severe consequences. The dispute may push buyers to demand clearer performance evidence, independent testing, and more explicit limits around what AI surveillance systems can and cannot guarantee.