How do the algorithms of Facebook and Instagram affect what you see in your news feed? To find out, Guardian Australia unleashed them on a completely blank smartphone linked to a new, unused email address.

Three months later, without any input, they were riddled with sexist and misogynistic content.

Initially Facebook served up jokes from The Office and other sitcom-related memes alongside posts from 7 News, Daily Mail and Ladbible. A day later it began showing Star Wars memes and gym or “dudebro”-style content.

By day three, “trad Catholic”-type memes began appearing and the feed veered into more sexist content.

Three months later, The Office, Star Wars, and now The Boys memes continue to punctuate the feed, now interspersed with highly sexist and misogynistic images that have have appeared in the feed without any input from the user.

  • CosmoNova@lemmy.world
    link
    fedilink
    English
    arrow-up
    130
    arrow-down
    3
    ·
    4 months ago

    I mean it‘s the exact same if you visit Youtube without an account or cookies. The Internet has become a swamp of right wing and neoliberal populism that kicks down on minorities and people with lower than average income in general. The insane amount of completely made up rage bait stories that you get recommended is just unfathomable.

    I think it‘s gotten to a point where it needs to be regulated how many lies a site can throw at you at the same time and I don‘t say this lightly. I just see no other way to get this mind eating populist machine under control.

    • Ismay@programming.dev
      link
      fedilink
      English
      arrow-up
      52
      arrow-down
      1
      ·
      4 months ago

      Youtube shorts are the worst. I am transgender so my historic is really not right wing

      30mins on shorts and I end up in Shapiro’s Dreamland. It’s a nightmare

        • Nythos@sh.itjust.works
          link
          fedilink
          English
          arrow-up
          8
          ·
          4 months ago

          My favourite thing about his shorts is trying to guess if it’s going to be a wholesome one or one where either him or his chat bestow cursed knowledge onto each other

      • Duamerthrax@lemmy.world
        link
        fedilink
        English
        arrow-up
        10
        ·
        4 months ago

        The only political thing I watch is Behind the Bastards and the algorithm keeps trying to get me to watch right wing shit. I installed a third party channel blocker and open suspicious channels in private tabs and it still serves me right wing chuds complaining about being suppressed by “woke google”. I would troll the comments section if it wasn’t for the fact that that counts as “engagement”.

      • 𝓔𝓶𝓶𝓲𝓮@lemm.ee
        link
        fedilink
        English
        arrow-up
        4
        ·
        edit-2
        4 months ago

        I despite all my lgbt content got served some 1 mil subs catholic lady saying how she loves red pill, pro life or something like this. Such women always have this crazy light in the eyes, it creeps me out.

        You can feel that she is in some kind of state of altered reality, like someone on drugs. High on something.

      • MirthfulAlembic@lemmy.world
        link
        fedilink
        English
        arrow-up
        3
        ·
        4 months ago

        It has either gotten better or just improved its suggestions for me over time. I basically never get right wing content anymore. There’s plenty of garbage, but it’s stupid garbage rather than dangerous garbage.

    • lemmyng@lemmy.ca
      link
      fedilink
      English
      arrow-up
      11
      arrow-down
      5
      ·
      4 months ago

      Regulation won’t work, because regulation moves slowly, and these companies find workarounds fast. And as long as the cost of breaking the rule is less than the benefits of doing so, it’ll be “just the cost of doing business.”

      • mat@jlai.lu
        link
        fedilink
        English
        arrow-up
        11
        ·
        4 months ago

        A simple way to do it is to stop considering them as platform providers but editors and it shou’d be done in my opinion because by their recommandation systems, they are making editing choices.

      • CosmoNova@lemmy.world
        link
        fedilink
        English
        arrow-up
        7
        arrow-down
        1
        ·
        4 months ago

        I have to hard disagree on this outmost pessimistic outlook because it reads like any regulation we already have is pointless so we can just scrap regulations and rules altogether across the board. That’s similar to the neoliberalist rethoric I loathe to see pushed into my recommendations and it’s simply not true. In reality we do see that regulations sometimes do the trick. It’s just that they likely won’t regulate them as harsh as I proposed, but that’s a different argument. Regulation as an instrument does work.

    • BlackLaZoR@kbin.run
      link
      fedilink
      arrow-up
      2
      arrow-down
      79
      ·
      4 months ago

      right wing and neoliberal populism

      Or maybe you just live in a swamp of left wing and radical socialism?

      • ℍ𝕂-𝟞𝟝@sopuli.xyz
        link
        fedilink
        English
        arrow-up
        45
        ·
        4 months ago

        That’s just the Netherlands.

        • wealth taxes ✓
        • insanely good infrastructure ✓
        • reasonable worker’s rights ✓
        • an actual swamp ✓
          • ℍ𝕂-𝟞𝟝@sopuli.xyz
            link
            fedilink
            English
            arrow-up
            11
            ·
            4 months ago

            Well, that just evidences that the only good way to do capitalism is with a wealth tax and unlimited paid sick leave.

              • Flying Squid@lemmy.worldM
                link
                fedilink
                English
                arrow-up
                3
                ·
                4 months ago

                In which country is capitalism working well? Because I can’t think of one that doesn’t have a desperately poor underclass. Just ones that have a good non-capitalist government safety net to help them.

              • ℍ𝕂-𝟞𝟝@sopuli.xyz
                link
                fedilink
                English
                arrow-up
                1
                ·
                edit-2
                4 months ago

                Nah, the capitalism parts of the NL are the most often criticised ones. It’s a tax haven for corps - did you know IKEA is a Dutch charity? - and the healthcare system is only getting worse because of copying US patterns of private ownership.

          • jpreston2005@lemmy.world
            link
            fedilink
            English
            arrow-up
            1
            ·
            4 months ago

            Capitalism, like every other form society takes, is inherently flawed. Power pools, and every system eventually falls into oligarchy. The only way to prevent this, is strong social welfare programs enacted with regularity. This is proven mathematically, here.

            The only reason capitalism works there is because of their strong social welfare programs.

            You’re wrong.

            • BlackLaZoR@kbin.run
              link
              fedilink
              arrow-up
              2
              arrow-down
              2
              ·
              4 months ago

              I can’t take this model seriously - it assumes that economy is a zero sum game. If an economy actually was the zero sum game, then where all the wealth came from???

              To be clear, I absolutely agree with the title - inequality is 100% unavoidable, but for completely different reasons.

              • jpreston2005@lemmy.world
                link
                fedilink
                English
                arrow-up
                1
                arrow-down
                1
                ·
                edit-2
                4 months ago

                then where all the wealth came from

                are you being serious right now, is this a real question? In the age of cryptocurrency you’re asking this question.

                • BlackLaZoR@kbin.run
                  link
                  fedilink
                  arrow-up
                  1
                  arrow-down
                  2
                  ·
                  edit-2
                  4 months ago

                  is this a real question?

                  I’m trying to point out the massive hole in the reasoning behind linked paper

                  In the age of cryptocurrency you’re asking this question.

                  Cryptocurrencies are barely relevant here

                  Edit: Wait. Are you a university student? What did they tell you about where the wealth is coming from? I’m genuinely curious to know.

  • Flying Squid@lemmy.worldM
    link
    fedilink
    English
    arrow-up
    94
    arrow-down
    2
    ·
    4 months ago

    I was explaining this to my daughter not long ago when she told me she kept getting recommended videos about something that offended her (I can’t remember what, but something Republicans would be in favor of) on YouTube that the algorithm doesn’t care whether or not you agree with the videos. It only cares about whether or not you’ll watch them. And if you’re willing to hate-watch, which many people are, you’ll get served the same videos as the people who enjoy it.

    And, of course, the more controversial the better because you’ll get a whole lot of both groups. So if you post something sexist and hateful, you’ll get a huge number of redpill viewers and the like and then all the other people who go to that post to argue with them. Which means the algorithm learns that those are the best things to push on new accounts too.

      • WindyRebel@lemmy.world
        link
        fedilink
        English
        arrow-up
        42
        arrow-down
        7
        ·
        4 months ago

        That’s just not true. Many people engage with things they don’t like because of education and curiosity.

        For instance, I don’t like your comment but I still engaged with it to point out that you’re wrong. I like Lemmy, in general, though.

        • Reyali@lemm.ee
          link
          fedilink
          English
          arrow-up
          33
          arrow-down
          1
          ·
          4 months ago

          I took that comment to be summarizing the platform’s perspective, rather than their own. I think it’s common sense that people will watch/engage with things they don’t like, but the algorithms don’t care about how you feel or why you watched something; they see engagement and they give you more of that thing to drive more engagement. As far as the unfeeling numbers go, engagement might as well be liking; they don’t need to distinguish a difference.

          • WindyRebel@lemmy.world
            link
            fedilink
            English
            arrow-up
            4
            arrow-down
            1
            ·
            edit-2
            4 months ago

            Sure, I saw that side of it too as I work in marketing but I took the comment at face value since it wasn’t specific about that intent. I’m happy to retract my comment if that’s what they meant.

            • bluGill@kbin.run
              link
              fedilink
              arrow-up
              3
              arrow-down
              1
              ·
              4 months ago

              That is what I meant - engage to facebook means you like it and want to see more.

      • Flying Squid@lemmy.worldM
        link
        fedilink
        English
        arrow-up
        21
        ·
        4 months ago

        As someone who used to sit around at a TV station for hours waiting for news to happen so I could go shoot it, I can tell you for a fact that you don’t have to like a show to watch it. You just have to be bored and it’s in front of you.

        That said, I did find out that American Ninja Warrior was amusing.

  • De_Narm@lemmy.world
    link
    fedilink
    English
    arrow-up
    57
    ·
    4 months ago

    That’s what happens if you only care about engagement. Chauvinism of any kind is liked by a certain amount of people and despised by the rest of us - both positions drive engagement.

    • Grandwolf319@sh.itjust.works
      link
      fedilink
      English
      arrow-up
      6
      ·
      4 months ago

      That’s why a format like lemmy is the only way. No desire for profit means we let the content do what it does organically.

  • madsen@lemmy.world
    link
    fedilink
    English
    arrow-up
    39
    arrow-down
    1
    ·
    edit-2
    4 months ago

    I think they vastly underestimate how many things Meta tracks besides ad tracking. They’re likely tracking how long you look at a given post in your feed and will use that to rank similar posts higher. They know your location, what wifi network you’re on and will use that to make assumptions based on others on the same network and/or in the same location. They know what times you’re browsing at and can correlate that with what’s trending in the area at those times, etc.

    I have no doubt that their algorithm is biased towards all that crap, but these kinds of investigations need to be more informed in order for them to be useful.

  • RubberDuck@lemmy.world
    link
    fedilink
    English
    arrow-up
    33
    arrow-down
    1
    ·
    edit-2
    4 months ago

    Well it also looks at stuff like the other devices connected from the same IP, other devices near where you connect from and then based on this also hones the served content.

    So if the author/some colleague or even the neighbors are red pilled/MGTOW/Chriso-Fachists etc this also makes sense. Possibly even their research into these subjects slanted the results. Let alone what happens if they spun up a VM at a cloud farm and used it from there.

    I’m in no way surprised that “social” media corps serve up vile shit for profit ik just not convinced by some random let’s see what happens.

    Edit: I’d be for a law that required targeted ads to have a small “why you see this” and if you click it the company is required to show you the selection criteria that caused this ad to be served to you in an easy to understand format. (Leaving out all the irrelevant criteria)… ie.

    You where selected by the following criteria:

    • region: europe
    • gender: male
    • interests: Games, Lemmy, politics
    • Carrolade@lemmy.world
      link
      fedilink
      English
      arrow-up
      22
      ·
      4 months ago

      It’s also probably looking at scroll speed. So if the people conducting the experiment tended to linger longer examining content they disliked, that could result in getting more of it.

      Would need to see a more detailed explanation of the methodology. Ideally the scrolling was done in an automated way, at a consistent speed.

      • localme@lemm.ee
        link
        fedilink
        English
        arrow-up
        10
        ·
        4 months ago

        Yep, it’s called dwell time and it is 100% one of the metrics used by the algorithms that decide what content to serve up.

  • schnurrito@discuss.tchncs.de
    link
    fedilink
    English
    arrow-up
    28
    ·
    4 months ago

    When I first joined Internet communities as a preteen, I just followed forums that interested me and got exposed to whatever people happened to be talking about on those forums.

    Why, oh why, has the world decided that we need recommendation algorithms at all?

    • jorp@lemmy.world
      link
      fedilink
      English
      arrow-up
      11
      ·
      4 months ago

      The algorithms aren’t there to improve the user experience they’re there to increase user engagement. People engage with things positively and they engage with things negatively. The algorithm doesn’t care.

      Why is every third Reddit post someone “accidentally misspelling” or otherwise humorously butchering a post title? Because people comment on it.

      • schnurrito@discuss.tchncs.de
        link
        fedilink
        English
        arrow-up
        4
        ·
        4 months ago

        Yes, so much this! I always believed that in the mobile internet era it would still be like this except we would be able to access it everywhere. Instead all we have is “platforms”. 🙁😡

        • originalucifer@moist.catsweat.com
          link
          fedilink
          arrow-up
          3
          ·
          4 months ago

          whats weird to me is that the kids today seem to require an ‘app’ per website . this requirement of their own choosing seems to lock them into whatever platform

          as an old person familiar with browsers since lynx, its baffling

          • schnurrito@discuss.tchncs.de
            link
            fedilink
            English
            arrow-up
            2
            ·
            4 months ago

            Apps aren’t even that bad an idea, by themselves. Transmitting only the actual information and not the entire UI every time is a good idea, even more so if the apps are FOSS and the services have open APIs (which admittedly is the exception).

            I grew up with IRC and of course everyone seriously using it used a standalone IRC client, not a browser chat interface.

            • originalucifer@moist.catsweat.com
              link
              fedilink
              arrow-up
              2
              ·
              edit-2
              4 months ago

              but the difference is between using an irc client to connect to any irc server and using ICQ to connect only to that one service.

              we purposefully updated browsers to enable dynamic content for exactly the reason you propose…efficiency. i cant count how many sites converted to ajaxy-goodness so we dont have to redraw the whole ui. we spent 20 years building ‘mobile-aware’ websites so devices with different screens could handle the same site without problem.

              i still get from the children, ‘is there an app for your site?’ yep; firefox.

    • ZILtoid1991@lemmy.world
      link
      fedilink
      English
      arrow-up
      2
      ·
      4 months ago

      And many people are refusing to leave Twitter, Facebook, Reddit, etc. due to those very same algorithms are not being present on Mastodon, Lemmy, etc.

    • ghostdoggtv@lemmy.world
      link
      fedilink
      English
      arrow-up
      1
      ·
      4 months ago

      Corporations realized infinite growth is unnatural and had to engineer a way to keep themselves marketable for rabid investors. Lo, and behold.

  • Blastboom Strice@mander.xyz
    link
    fedilink
    English
    arrow-up
    24
    arrow-down
    1
    ·
    edit-2
    4 months ago

    I have a ~3year old fb account because I have to use messenger. I don’t use FB almost at all (I even sparingly accept friend requests) and have turned off ~anything that provides targeted content (I live in EU).

    Since about last year (or possibly even before), my feed is about 35% Ikaria ads (a Greek island, I’m from Greece), 10% porn, 10% sexist-misogynistic stuff, 15% sexist-misogynistic porn, 15% christian stuff and the rest random stuff.

    At least this might confirm that turning off targeted content works…🤷

    • Flying Squid@lemmy.worldM
      link
      fedilink
      English
      arrow-up
      7
      ·
      4 months ago

      I use Facebook because my relatives are spread out across the world and that’s the way I know to stay in touch and also my brother, who is neurodivergent, mostly likes to communicate to the family as a whole that way and I want to be able to stay in touch with him too. On top of that, I’m stuck in a town I hate with no friends here and some old friends from my hometown are there so I can talk to them.

      Anyway, ever since my brother started talking about how he was taking various hallucinogenic substances and calling himself a psychonaut (he’s almost 60, he got into it very late), most of the ads I see are for shroom gummies, ketamine and boner pills. I’ve done my “psychonaut” stuff back when I was in my teens and twenties. I’m not interested in the former two and the latter is, thankfully, not necessary yet.

      The funny thing was that maybe 4 or 5 years ago, I kept getting shown an ad for a wooden hurdy-gurdy kit. Like the medieval instrument. I have no idea why. I have never expressed an interest in playing the hurdy-gurdy, listening to the hurdy-gurdy or building anything out of a wooden kit. It became a joke with me and my friends for a while.

    • thanks_shakey_snake@lemmy.ca
      link
      fedilink
      English
      arrow-up
      1
      ·
      4 months ago

      You know, you can just use Messenger on its own, on desktop web or mobile. I also need to use Messenger in some limited capacity and I have no idea what my feed looks like :)

      • Blastboom Strice@mander.xyz
        link
        fedilink
        English
        arrow-up
        1
        ·
        edit-2
        4 months ago

        You mean without a fb account? I think you’re right, but I think this wasn’t possible when I made the account ~3years ago.

        About desktop web, I’m only using the website on my pc (and I have isolated the app on work profile on my android, while turning off ads with an lsposed module).

        • thanks_shakey_snake@lemmy.ca
          link
          fedilink
          English
          arrow-up
          1
          ·
          4 months ago

          Oh, no, I mean I have an account, but I never (…exceedingly rarely) go on Facebook itself. messenger.com is just the messenger with no feed or other features, and there’s a standalone mobile app called Messenger as well, same idea. I use those when I need to interact with someone over Facebook so that I’m not exposed to most of the crap.

          I don’t know anything about using it totally without any account.

          • Blastboom Strice@mander.xyz
            link
            fedilink
            English
            arrow-up
            1
            ·
            4 months ago

            Ahhh, yeah. I too use the messenger app on mobile and the messenger website on pc.

            I just happen to open facebook (I have an open source front end client) from time to time out of boredom, because it’s kinda amusing how bad my feed is :)

  • NotMyOldRedditName@lemmy.world
    link
    fedilink
    English
    arrow-up
    19
    ·
    edit-2
    4 months ago

    So these algos they time how long you look at things when scrolling. So to begin, sure there’s no user input, but the mere act of looking unless controlled to be exactly the same on everything is in fact input.

    Getting a sexist thing and lingering on it for an extra 5 seconds tells the algo you engaged with the sexist thing so send them more sexist things.

    Edit: it shouldn’t be serving it up at all, but that’s how this can happen.

    • Wes4Humanity@lemm.ee
      link
      fedilink
      English
      arrow-up
      4
      ·
      4 months ago

      I wonder if they did any other Internet activities on the phone at all too… I don’t know for sure if it matters, but I wouldn’t be surprised if Facebook can track where you go or have been on the Internet to some degree.

      • NotMyOldRedditName@lemmy.world
        link
        fedilink
        English
        arrow-up
        7
        ·
        edit-2
        4 months ago

        Absolutely, that’s the whole tracking ID thing.

        Apple makes that required to opt in now, I don’t think that’s the case in all Android devices yet though?

    • P1r4nha@feddit.de
      link
      fedilink
      English
      arrow-up
      7
      ·
      4 months ago

      Hate and outrage has shown to be most engaging emotions. All recommendation algorithms will gravitate towards it.

  • BurningnnTree@lemmy.one
    link
    fedilink
    English
    arrow-up
    2
    arrow-down
    6
    ·
    4 months ago

    The two examples of misogynistic memes in this article are really tame IMO. It’s the type of humor that teenage boys have always had, long before the existence of social media. Don’t get me wrong, I definitely think social media algorithms are having a major negative impact on society. But I don’t think content like this is the problem.