Detroit woman sues city after being falsely arrested while pregnant due to facial recognition technology::A Detroit woman is suing the city and a police detective after she was falsely arrested because of facial recognition technology while she was eight months pregnant, according to court documents.

  • phillaholic@lemm.ee
    link
    fedilink
    English
    arrow-up
    27
    arrow-down
    1
    ·
    1 year ago

    This is a Systemic Bias; in this case Systemic racism.

    The outcome a product or service disproportionately targets Black people. It wasn’t designed to do it, so it’s not overt racism, it just worked out that way.

    Camera systems inherently have a harder time with dark skin. That’s a fact. However it’s been found time and time again that these systems are predominantly created by and tested on light skin individuals. So the bias is built into the flawed creation. You can see this in Hollywood where lighting has only recently been set up to highlight dark skin with majority black casts and show runners in shows like Atlanta and Insecure.

    • gelberhut@lemdro.id
      link
      fedilink
      English
      arrow-up
      3
      arrow-down
      12
      ·
      1 year ago

      Could you please point where it targets disproportionally black. Does it recognizes black people instead of white? this would be a racism.

      If it just recognizes completely wrong faces for black people - it is a shitty quality which, buy the way, works in favour of black criminals.

        • gelberhut@lemdro.id
          link
          fedilink
          English
          arrow-up
          1
          arrow-down
          8
          ·
          1 year ago

          Yes, I know. And I agree that when this happens in conditions when a human can do the work well - it is a bias. However, when this happens in conditions when a human cannot do the work either it could be a physic, like dark is worse visible in darkness.

          And in exactly discussed case it is not that clear what was the reason.

          it is a matter of interpretation as well: one can say “a system helps black criminals to avoid being arrested”.

          For me, this false reconginision statistic is an alarming signal which says that the system works bad and deeper analyses must be done, and meanwhile, police must be more accurate dealing with its results.

          • phillaholic@lemm.ee
            link
            fedilink
            English
            arrow-up
            4
            ·
            1 year ago

            The outcome of the bad technology and policing is disproportionately effecting dark skinned people. That’s where it becomes systemic racism. No one decided to design a system to arrest more blacks people. The outcome of various factors ended that way however. Sometimes it’s just a consequence of nature, but most of the time there are clear reasons like lack of representation in design and testing that would have found the problems earlier.

            • gelberhut@lemdro.id
              link
              fedilink
              English
              arrow-up
              1
              arrow-down
              1
              ·
              edit-2
              1 year ago

              Where did you read about “arrest more black people”? They say it points to wrong people when a criminal has black skin. You can also describe it “helps black criminals hide them self”.

              I’m absolutely with you being against racism and other discriminations, but exactly in this case rasims and bias is not that relevant. Overusing terms like “rasism” makes the team weaker and people start consider it as a minor thing. Like one associates “racism” with non ideal snarcamera settings, what is dangerous.

              • phillaholic@lemm.ee
                link
                fedilink
                English
                arrow-up
                2
                ·
                1 year ago

                Arrests more innocent black or darker skinned people is what I meant.

                I’m not overusing the term, you’re conflating two types of racism, and need to understand the context in order to understand what others are speaking about. If you just assume everyone is talking about overt racism all the time, you’re going to jump to the wrong conclusions and probably think people are being dramatic or ridiculous half the time.