Cross posted from https://lemmy.cafe/post/42741995

cross-posted from: https://beehaw.org/post/29490552

After school on October 20, 2025, 16-year-old Taki Allen was waiting with three friends outside Kenwood High School in Baltimore County, Maryland, for a ride home from football practice. Allen was eating a bag of Doritos. Suddenly, at least six Baltimore County Police Department vehicles arrived at the scene, and officers leapt out, guns drawn, forcing the boys to the ground and searching them.

The teens hadn’t done anything wrong. But Omnilert Gun Detect, an artificial intelligence weapon-detection system that scans security footage for firearms, had used the school cameras to misidentify Allen’s bag of chips as a gun.

Allen and his classmates Yui-Osa Ogbeide, Devon Thompson Jr., and Keith Winfield III are all Black[1]^. The Lawyers’ Committee for Civil Rights Under Law filed a lawsuit on their behalf Tuesday against the police department, the Baltimore County board of education, school administrators, and several individual officers.

“The encounter was terrifying and life-threatening,” the lawsuit says. “With armed police encircling them for no apparent reason, each student feared for his life and the lives of his friends.”

After failing to find anything in the search, one police officer reportedly told the students, “AI is not the best,” and another said, “Fucking Omnilerts.” As the officers were leaving, another said, “Hey, thanks for not running away, that would have been a real problem.”


  1. because of course they are ↩︎

  • joeschmoe@lemmy.world
    link
    fedilink
    English
    arrow-up
    4
    ·
    1 hour ago

    Can’t wait till the stupid AI, they implemented in the FAA, let’s two planes crash, because it gave both the green light to the same runway. Maybe we will also see some stupid AI implemented in freight train traffic, and it let’s two trains horrifically crash.

    I hate C-suites and AI bros.

    • P03 Locke@lemmy.dbzer0.com
      link
      fedilink
      English
      arrow-up
      2
      ·
      1 hour ago

      That’s what caught me, too. I mean, obviously the cops are tired of it, so why hasn’t the whole department drop-kicked the shit in the garbage? It sounds like the police would gladly do so.

  • papalonian@lemmy.world
    link
    fedilink
    English
    arrow-up
    58
    ·
    7 hours ago

    After it identified Allen’s doritos as a firearm, it sent a text message to a group of school administrators and police, who reviewed the alert and canceled it. But 10 minutes later, the school principal sent a screenshot of the footage in the security alert to a co-worker, who sent it to the police department, who then responded at the scene.

    AI shouldn’t be used in school security cameras. But, after the alert was already noted as a false flag and cancelled, why tf would the coworker forward it to the police, and why tf would the police respond to a screenshot of a bag of Doritos flagged as a gun?

    Oh yeah, literally everyone involved with all the decisions made here is fucking braindead.

    • halcyoncmdr@piefed.social
      link
      fedilink
      English
      arrow-up
      2
      ·
      2 hours ago

      why tf would the police respond to a screenshot of a bag of Doritos flagged as a gun

      Devil’s advocate here, as unlikely as it is… it is relevant to discuss.

      10 minutes later, the school principal sent a screenshot of the footage in the security alert to a co-worker, who sent it to the police department

      Have they publicly released the actual image/text/message that was sent to the police?

      Because the specific image sent can provide context for the exact information the police received. The specific screenshot itself might mean very little if the police know it is coming from a human watching a video and sending a single still frame. From their perspective, someone at the school probably saw someone put a gun into the Doritos bag and just took a screenshot of the bag at the end instead of wasting time to scrub through footage and send a better image.

      Police often receive very little information before getting onto a scene, anyone that’s even been on a ride-along will tell you they often get absolutely no information about a situation before getting there. If all the officers got relayed was that a person sent a message saying “gun hidden in doritos bag”, and a picture of a doritos bag, they’re going to be operating with only that information. There is no good reason for a student to be concealing a gun inside a chip bag.

      What would you expect them to do with only that info? They are supposed to just assume the part about the gun isn’t real? Or assume the person sending the info is wrong? Then you’d be complaining that they didn’t respond to prevent a school shooting even though they were warned.

      Without knowing EXACTLY what was relayed to the police department, and what was then actually relayed to the officers on scene (because that is not always the same set of info) we’re all making some pretty big assumptions.

    • Viking_Hippie@lemmy.dbzer0.com
      link
      fedilink
      English
      arrow-up
      12
      ·
      5 hours ago

      And why the fuck would the principal send that screenshot to a (likely racist and alarmist based on their reaction) coworker if not in a deliberate attempt to endanger or at least “scare straight” a bunch of kids? 🤦🏻🤬

      • papalonian@lemmy.world
        link
        fedilink
        English
        arrow-up
        4
        ·
        5 hours ago

        I could see the principal sending it to someone as like “haha look at this dumb computer thinking Doritos are a gun” but should have definitely put a message along with it.

    • Not a newt@piefed.ca
      link
      fedilink
      English
      arrow-up
      9
      ·
      5 hours ago

      It doesn’t even necessarily have to be a malicious action. There’s so much cognitive offloading happening that it’s very plausible that the principal went full meat proxy mode, didn’t read the thread where the administrators canceled the alert, and just blindly forwarded it. Which is just as bad, because both cases are dereliction of duty.

  • ef9357@lemmy.world
    link
    fedilink
    English
    arrow-up
    14
    ·
    6 hours ago

    HITL (human in the loop) is supposed to prevent this. I guess the clowns involved in this don’t qualify.