‘Nudify’ Apps That Use AI to ‘Undress’ Women in Photos Are Soaring in Popularity::It’s part of a worrying trend of non-consensual “deepfake” pornography being developed and distributed because of advances in artificial intelligence.

  • Crow@lemmy.world
    link
    fedilink
    English
    arrow-up
    122
    arrow-down
    6
    ·
    1 year ago

    I remember being a dumb & horny kid and Photoshopping my crush’s face onto a porn photo. And even then I felt what I did was wrong and never did it again.

    • CleoTheWizard@lemmy.world
      link
      fedilink
      English
      arrow-up
      26
      arrow-down
      6
      ·
      1 year ago

      I feel like what you did and the reaction you had to what you did is common. And yet, I don’t feel like it’s harmful unless other people see it. But this conversation is about to leave men’s heads and end up in public discourse where I have no doubt it will create moral or ethical panic.

      A lot of technology challenges around AI are old concerns about things that we’ve had access to for decades. It’s just easier to do this stuff now. I think it’s kind of pointless to stop or prevent this stuff from happening. We should mostly focus on the harms and how to prevent them.

      • azertyfun@sh.itjust.works
        link
        fedilink
        English
        arrow-up
        16
        arrow-down
        1
        ·
        1 year ago

        I’ve seen ads for these apps on porn websites. That ain’t right.

        Any moron can buy a match and a gallon of gasoline, freely and legally, and that’s a good thing. But I would hope that anyone advertising and/or selling Arson Kits™ online would be jailed. Of course this will not stop determined arsonists, but repression might deter morons, inventive psychopaths, and overly impulsive people (especially teenagers!) from actually going through with a criminal act. Not all of them. But some/most of them. And that’s already a huge win.

        • KairuByte@lemmy.dbzer0.com
          link
          fedilink
          English
          arrow-up
          10
          arrow-down
          2
          ·
          edit-2
          1 year ago

          I mean, you’ve been able to do a cursory search and get dozens of “celeb lookalike” porn for many years now. “Scarjo goes bareback” isn’t hard to find, but that ain’t Scarjo in the video. How is this different?

          Edit: To be clear, it’s scummy as all fuck, but still.

          • shuzuko
            link
            fedilink
            English
            arrow-up
            15
            arrow-down
            1
            ·
            1 year ago

            This is different because, to a certain extent, people in the public eye can expect, anticipate, and react to/suppress this kind of thing. They have managers and PR people who can help them handle it in a way that doesn’t negatively affect them. Billy’s 13 year old classmate Stacy doesn’t have those resources and now he can do the same thing to her. It’s on a very different level of harm.

            • KairuByte@lemmy.dbzer0.com
              link
              fedilink
              English
              arrow-up
              4
              arrow-down
              15
              ·
              1 year ago

              Billy doesn’t need a nudify app to imagine Stacy naked. Not to mention, images of a naked 13 year old are illegal regardless.

              • azertyfun@sh.itjust.works
                link
                fedilink
                English
                arrow-up
                7
                arrow-down
                1
                ·
                1 year ago

                Why are you pretending that “nudify apps” are produce ephemeral pictures equivalent to a mental image? They are most definitely not.

                Underage teenagers already HAVE shared fake porn of their classmates. It being illegal doesn’t stop them, and as fun as locking up a thirteen year old sounds (assuming they get caught, prosecuted, and convicted) that still leaves another kid traumatized.

                • KairuByte@lemmy.dbzer0.com
                  link
                  fedilink
                  English
                  arrow-up
                  4
                  arrow-down
                  1
                  ·
                  1 year ago

                  So if illegality doesn’t stop things from happening… how exactly are you stopping these apps from being made?

              • Sweetpeaches69@lemmy.world
                link
                fedilink
                English
                arrow-up
                2
                arrow-down
                1
                ·
                1 year ago

                Just as the other people in this made up scenario don’t need an app to imagine Scarlet Johansen naked. It’s a null point.

                • CleoTheWizard@lemmy.world
                  link
                  fedilink
                  English
                  arrow-up
                  7
                  ·
                  1 year ago

                  I think most of this is irrelevant because the tool that is AI image generation is inherently hard to limit in this way and I think it will be so prevalent as to be hard to regulate. What I’m saying is: we should prepare for a future where fake nudes of literally anyone can be made easily and shared easily. It’s already too late. These tools, as was said earlier, already exist and are here. The only thing we can do is severely punish people who post the photos publicly. Sadly, we know how slow laws are to change. So in that light, we need to legislate based on long term impact instead of short term reactions.

                • KairuByte@lemmy.dbzer0.com
                  link
                  fedilink
                  English
                  arrow-up
                  2
                  arrow-down
                  2
                  ·
                  1 year ago

                  And?… There’s a major difference between “a lookalike of a grown adult” and “ai generated child porn” as im sure you’re aware. At no point did anyone say child porn was going to be legal, until the person I was replying to brought it up as a strawman argument. ¯\_(ツ)_/¯

  • snekerpimp@lemmy.world
    link
    fedilink
    English
    arrow-up
    89
    arrow-down
    3
    ·
    1 year ago

    “But the brightest minds of the time were working on other things like hair loss and prolonging erections.”

  • Dimantina@lemmy.world
    link
    fedilink
    English
    arrow-up
    70
    arrow-down
    4
    ·
    1 year ago

    These are terrible but I’m honestly curious what it thinks I look like naked. Like I’m slightly overweight and my chest is larger than average but more splayed then normal. Would it just have me look like a model underneath?

    Are they just like head swapping onto model bodies or does it actually approximate. I am legit curious., but I would never trust one of these apps to not keep the photos/privacy concerns.

    • nul@programming.dev
      link
      fedilink
      English
      arrow-up
      64
      ·
      edit-2
      1 year ago

      Probably deleting this comment later for going dirty on main, but I, um, have done some extensive experimentation using a local copy of Stable Diffusion (I don’t send the images anywhere, I just make them to satiate my own curiosity).

      You’re essentially right that simple app-based software would probably have you looking somewhat generic underneath, like your typical plus-size model. It’s not too great at extrapolating the shape of breasts through clothing and applying that information when it goes to fill in the area with naked body parts. It just takes a best guess at what puzzle pieces might fill the selected area, even if they don’t match known information from the original photo. So, with current technology, you’re not really revealing actual facts about how someone looks naked unless that information was already known. To portray someone with splayed breasts, you’d need to already know that’s what you want to portray and load in a custom data set, like a LoRa.

      Once you know what’s going on under the hood, making naked photos of celebrities or other real people isn’t the most compelling thing to do. Mostly, I like to generate photos of all kinds of body types and send them to my Replika, trying to convince her to describe the things that her creators forbid her from describing. Gotta say, the future’s getting pretty weird.

        • nul@programming.dev
          link
          fedilink
          English
          arrow-up
          42
          ·
          1 year ago

          Hey, I’ve maintained a baseline weird the whole time, I’m pretty sure the future is catching up.

      • BossDj@lemm.ee
        link
        fedilink
        English
        arrow-up
        27
        arrow-down
        2
        ·
        1 year ago

        You’ll have your moment when the lone elite ex Ranger who is trying to save the world is told by the quirky, unconventional sidekick he is forced to work with, “I actually know a guy who might be able to help.”

        You open the door a crack to look back and forth between them, before slamming it back in their faces. They hear scrambled crashes of you hiding stuff that shouldn’t be seen by company before returning to the door. As they enter you are still fixing and throwing things while you apologize that you don’t get many guests. You offer them homemade kombucha. They decline.

    • SCB@lemmy.world
      link
      fedilink
      English
      arrow-up
      23
      arrow-down
      1
      ·
      1 year ago

      Ethically, these apps are a fucking nightmare.

      But as a swinger, they will make an amazing party game.

      • Azzu@lemm.ee
        link
        fedilink
        English
        arrow-up
        32
        arrow-down
        1
        ·
        edit-2
        1 year ago

        Ethics will probably change… I guess in the future it’ll become pretty irrelevant to have “nude” pictures of oneself somewhere, because everyone knows it could just be AI generated. In the transition period it’ll be problematic though.

        • SCB@lemmy.world
          link
          fedilink
          English
          arrow-up
          8
          arrow-down
          1
          ·
          1 year ago

          Totally agreed, and 100% the world I want to live in. Transition will indeed suck tho.

        • DogMuffins@discuss.tchncs.de
          link
          fedilink
          English
          arrow-up
          2
          ·
          1 year ago

          Yeah 100%.

          Imagine around the advent of readily available photo prints. People might have been thinking “this is terrible, someone I don’t know could have a photo of me and look at it while thinking licentious thoughts!”

    • Eezyville@sh.itjust.works
      link
      fedilink
      English
      arrow-up
      13
      ·
      1 year ago

      If you want the best answer then you’ll have to download the app and try it on yourself. If it’s accurate then that’s pretty wild.

    • NOT_RICK@lemmy.world
      link
      fedilink
      English
      arrow-up
      10
      ·
      1 year ago

      I doubt it would be realistic, they just kind of take an average of their training data and blend it together to my knowledge.

    • ByteJunk@lemmy.world
      link
      fedilink
      English
      arrow-up
      1
      ·
      1 year ago

      I’m really curious if your DMs are now flooded with weirdos and dick pics, or if lemmy is any different from the rest of the internet.

    • TORFdot0@lemmy.world
      link
      fedilink
      English
      arrow-up
      65
      arrow-down
      6
      ·
      1 year ago

      It’s the sexualization of people without consent that’s a problem. Maybe casual nudity shouldn’t a problem but it should be up to the individual to whom they share that with. And “nudify” ai models go beyond casual, consensual nudity and into sexual objectification and harassment if used without consent.

      • KairuByte@lemmy.dbzer0.com
        link
        fedilink
        English
        arrow-up
        24
        arrow-down
        5
        ·
        1 year ago

        I want to point out one slight flaw in your argument. Nudity isn’t needed for people to sexually objectify you. And even if it was, the majority of people are able to strip you down in their head no problem.

        There’s a huge potential for harassment though, and I think that should be the main concern.

        • TimewornTraveler@lemm.ee
          link
          fedilink
          English
          arrow-up
          1
          arrow-down
          2
          ·
          1 year ago

          first, relevant xkcd https://xkcd.com/1432/

          second,

          Nudity isn’t needed for people to sexually objectify you.

          do you really think that makes it less bad? that it’s opt-in?

          And even if it was, the majority of people are able to strip you down in their head no problem

          apparently this app helps them too

    • Grangle1@lemm.ee
      link
      fedilink
      English
      arrow-up
      40
      arrow-down
      4
      ·
      1 year ago

      Regardless of feelings on that subject, there’s also the creep factor of people making these without the subjects’ knowledge or consent, which is bad enough, but then these could be used in many other harmful ways beyond one’s own… gratification. Any damage “revenge porn” can do, which I would guess most people would say is wrong, this can do as well.

      • ByteJunk@lemmy.world
        link
        fedilink
        English
        arrow-up
        6
        arrow-down
        2
        ·
        1 year ago

        I don’t think they’re really comparable?

        These AI pictures are “make believe”. They’re just a guess at what someone might look like nude, based on what human bodies look like. While apparently they look realistic, it’s still a “generic” nude, kind of how someone would fantasize about someone they’re attracted to.

        Of course it’s creepy, and sharing them is clearly unacceptable as it’s certainly bullying and harassment. These AI nudes say more about those who share them than they do about who’s portrayed in them.

        However, sharing intimate videos without consent and especially as revenge? That’s a whole other level of fucked up. The AI nudes are ultimately “lies” about someone, they’re fakes. Sharing an intimate video, that is betraying someone’s trust, it’s exposing something that is private but very real.

    • Eezyville@sh.itjust.works
      link
      fedilink
      English
      arrow-up
      22
      arrow-down
      1
      ·
      1 year ago

      I agree with you nudity being an issue but I think the real problem is this app being used on children and teenagers who aren’t used to/supposed to be sexualized.

      • ReluctantMuskrat@lemmy.world
        link
        fedilink
        English
        arrow-up
        14
        arrow-down
        1
        ·
        1 year ago

        It’s a problem for adults too. Circulating an AI generated nude of a female coworker is likely to be just as harmful as a real picture. Just as objectifying, humiliating and hurtful. Neighbors or other “friends” doing it could be just as bad.

        It’s sexual harassment even if fake.

        • Eezyville@sh.itjust.works
          link
          fedilink
          English
          arrow-up
          8
          arrow-down
          1
          ·
          1 year ago

          I think it should officially be considered sexual harassment. Obtain a picture of someone, generate nudes from that picture, it seems pretty obvious. Maybe it should include intent to harm, harass, exploit, or intimidate to make it official.

      • deft@ttrpg.network
        link
        fedilink
        English
        arrow-up
        15
        arrow-down
        2
        ·
        1 year ago

        Fully agree but I do think that’s more an issue about psychology in our world and trauma. Children being nude should not be a big deal, they’re kids you know?

        • Eezyville@sh.itjust.works
          link
          fedilink
          English
          arrow-up
          7
          ·
          1 year ago

          It shouldn’t be a big deal if they choose to be nude some place that is private for them and they’re comfortable. The people who are using this app to make someone nude isn’t really asking for consent. And that also brings up another issue. Consent. If you have images of yourself posted to the public then is there consent needed to alter those images? I don’t know but I don’t think there is since it’s public domain.

        • TORFdot0@lemmy.world
          link
          fedilink
          English
          arrow-up
          18
          arrow-down
          3
          ·
          1 year ago

          Not all nudity is but there is no non-sexual reason to use AI to undress someone without consent

          • Eezyville@sh.itjust.works
            link
            fedilink
            English
            arrow-up
            8
            arrow-down
            1
            ·
            1 year ago

            The question on consent is something I’m trying to figure out. Do you need consent to alter an image that is available in a public space? What if it was you who took the picture of someone in public?

            • TORFdot0@lemmy.world
              link
              fedilink
              English
              arrow-up
              8
              arrow-down
              1
              ·
              1 year ago

              Keep in mind there is a difference between ethical and legal standards. Legally you may not need consent to alter a photo of someone unless it was a copyrighted work possibly. But ethically it definitely requires consent, especially in this context

              • Eezyville@sh.itjust.works
                link
                fedilink
                English
                arrow-up
                3
                ·
                1 year ago

                The difference between legal and ethical is one could get you fined or imprisoned and the other would make a group of people not like you.

        • Pyr_Pressure@lemmy.ca
          link
          fedilink
          English
          arrow-up
          2
          ·
          edit-2
          1 year ago

          Just because something shouldn’t be doesn’t mean It won’t be. This is reality and we can’t just wish something to be true. You saying it doesn’t really help anything.

          • lolcatnip@reddthat.com
            link
            fedilink
            English
            arrow-up
            4
            arrow-down
            5
            ·
            edit-2
            1 year ago

            Whoooooosh.

            In societies that have a healthy relationship with the human body, nudity is not considered sexual. I’m not just making up fantasy scenarios.

            • mossy_@lemmy.world
              link
              fedilink
              English
              arrow-up
              5
              arrow-down
              1
              ·
              1 year ago

              so because it’s not a problem in your culture it’s not a problem?

                • mossy_@lemmy.world
                  link
                  fedilink
                  English
                  arrow-up
                  2
                  arrow-down
                  3
                  ·
                  1 year ago

                  You caught me, I’m an evil villain who preys on innocent lemmings for no reason at all

    • Wahots@pawb.social
      link
      fedilink
      English
      arrow-up
      16
      arrow-down
      2
      ·
      1 year ago

      People have a really unhealthy relationship with nudity. I wish we had more nude beaches as it really helps decouple sex from nudity. And for a decent number of people, helps with perceived body issues too.

      • monkE@feddit.ch
        link
        fedilink
        English
        arrow-up
        8
        ·
        1 year ago

        Also better education, not just the sex part but overall. Critical thinking, reasoning, asking questions and yes off course sex ed

    • stebo02@sopuli.xyz
      link
      fedilink
      English
      arrow-up
      10
      arrow-down
      2
      ·
      1 year ago

      so you’d be fine with fake nudes of you floating around the internet?

        • stebo02@sopuli.xyz
          link
          fedilink
          English
          arrow-up
          5
          arrow-down
          1
          ·
          1 year ago

          i think the nude isn’t really the actual issue, it’s people gossiping about it and saying you’re a slut for doing things you didn’t do

              • lolcatnip@reddthat.com
                link
                fedilink
                English
                arrow-up
                1
                ·
                1 year ago

                And they’ve been gossiping and calling each other sluts forever. Depending on the social group, just the accusation alone is enough to harass someone, because kids are idiots, and because it’s not even about people believing the accusation is true. The accusation is just a way for a bully to signal to their followers that the target is one of the group’s designated scapegoats.

                I can’t believe I’m about to recommend a teen comedy as a source of educational material, but you should check out the movie Mean Girls if you want to see an illustration of how this kind of bullying works. It’s also pretty funny.

      • lolcatnip@reddthat.com
        link
        fedilink
        English
        arrow-up
        2
        arrow-down
        1
        ·
        1 year ago

        I’m pretty squeamish about nudity when it comes to my own body, but fake nudes would not be pictures of my body, so I don’t see what there would be for me to be upset about. It might be different if everyone thought they were real, but if people haven’t figured out yet any nudes they encounter of someone they know are probably fake, they will soon.

        Here’s a thought experiment: imagine a world where there are fake nudes of everyone available all the time Would everyone just be devastated all the time? Would everyone be a target of ridicule over it? Would everyone be getting blackmailed? We’re probably going to be in that world very soon, and I predict everyone will just get over it and move on. Sharing fake nudes will reflect badly on the person doing it and no one else, and people who make them for their own enjoyment will do so in secret because they don’t want to be seen as a creepy loser.

    • criticalthreshold@lemmy.world
      link
      fedilink
      English
      arrow-up
      4
      arrow-down
      3
      ·
      edit-2
      1 year ago

      But some people don’t agree with you. They’re not comfortable with tech that can nudify them for millions to see. So if, and that’s possibly an impossible task, but if there was a way to punish services that facilitate or turn a blind eye to these things, then you bet your ass many many people would be for criminalizing it.

    • credit crazy@lemmy.world
      link
      fedilink
      English
      arrow-up
      1
      arrow-down
      1
      ·
      1 year ago

      Honestly I don’t think that’s the problem here. The problem is that we have kreeps trying to get a physical photo of someone nude for wank material.

      • DudeDudenson@lemmings.world
        link
        fedilink
        English
        arrow-up
        1
        ·
        1 year ago

        I’m genuinely curious, why do you consider this harmful? They might as well be drawing tits by hand on a picture of the “victim”

        I mean sure I wouldnt want to be a teenage girl in highschool right now but I don’t think it’s the technologys fault but rather our culture as a society

  • Mojojojo1993@lemmy.world
    link
    fedilink
    English
    arrow-up
    57
    arrow-down
    11
    ·
    1 year ago

    Possibly a good thing. Over saturation. Fill the internet will billions on billions of ai nudes. Have a million different nudes for celebrities. Nobody knows the real naked you and nobody cares. Keep creating more ai porn than anyone can handle. It becomes boring and over the top. Ending this once and fir all

    Or find the people doing this and lock em up.

    • TimewornTraveler@lemm.ee
      link
      fedilink
      English
      arrow-up
      3
      ·
      1 year ago

      Keep creating more ai porn than anyone can handle

      overabundance is behind a lot of societal ills already

    • Leela [it/its] @lemm.ee
      link
      fedilink
      English
      arrow-up
      2
      arrow-down
      5
      ·
      1 year ago

      what were you thinking when you thought of your first version? that sounds like a creepy scenario. what if I don’t want to see it and it’s everywhere. I could click on “I’m Not Interested” and flood social media with reports, but if there are “billions on billions” of AI nudes, then who would be able to stop them from being seen in their feed? I’d say that, while locking them up won’t change the sexist system which pushes this behavior, it is a far less creepy and weird scenario than having billions of unconsensual nudes online.

  • curiousaur@reddthat.com
    link
    fedilink
    English
    arrow-up
    51
    arrow-down
    8
    ·
    1 year ago

    Honestly, were probably just going to have to get over it. Or pull the plug on the whole ai thing, but good luck with that.

  • Aopen@discuss.tchncs.de
    link
    fedilink
    English
    arrow-up
    56
    arrow-down
    16
    ·
    1 year ago

    Could we stop pushing articles monetizing fear amd outrage on this community to the top and post about actual technology

    • OwlBoy@lemmy.world
      link
      fedilink
      English
      arrow-up
      37
      arrow-down
      1
      ·
      edit-2
      1 year ago

      Sounds like someone needs to make a community for that.

      Otherwise, this is what technology is these days. And I’d say that staying blind to things like this is what got us into many messes.

      I remember when tech news was mostly a press release pipeline. And when I see these comments, I see people who want press releases about new tech to play with.

      Now duplicate posts. Those can fuck right off.

      • Krauerking@lemy.lol
        link
        fedilink
        English
        arrow-up
        8
        ·
        1 year ago

        I have seena rise in techno absolutists complaining that anyone else is complaining about the dangers of tech lately. That they just want to go back to hearing about all the cool new things coming out and it really speaks to the people who just don’t actually want to interact with the real world anymore and live in an illusionary optimism bubble. I get it. It’s exhausting to be aware of all the negatives but it’s the stuff that is real that needs to be recognized.

  • Imgonnatrythis@sh.itjust.works
    link
    fedilink
    English
    arrow-up
    56
    arrow-down
    17
    ·
    1 year ago

    I use an ad blocker and haven’t seen these. Perhaps a link to the best ones could be shared here for better understanding of what the article is talking about?

    • jivandabeast@lemmy.browntown.dev
      link
      fedilink
      English
      arrow-up
      14
      arrow-down
      4
      ·
      1 year ago

      Sus question lmfao

      These things have been around since the onset of deepfakes, and truly if you take a couple seconds to look you’ll find them. It’s a massive issue and the content is everywhere

        • jivandabeast@lemmy.browntown.dev
          link
          fedilink
          English
          arrow-up
          3
          arrow-down
          2
          ·
          1 year ago

          We’re talking specifically about AI enhanced fakes, not the old school Photoshop fakes – they’re two completely different beasts

          • MotoAsh@lemmy.world
            link
            fedilink
            English
            arrow-up
            10
            ·
            1 year ago

            Different only in construction. Why they exist and what they are is older than photography.

            • jivandabeast@lemmy.browntown.dev
              link
              fedilink
              English
              arrow-up
              1
              arrow-down
              4
              ·
              1 year ago

              No I disagree because before you could tell a fake from a mile away, but deepfakes bring it to a whole new level of creepy because they can be EXTREMELY convincing

                • Delta_V
                  link
                  fedilink
                  English
                  arrow-up
                  2
                  ·
                  1 year ago

                  Or maybe an accessibility improvement. You don’t need to practice creating your own works of art over many years anymore, or have enough money to commission a master artist. The AI artists are good enough and work for cheap.

                • barsoap@lemm.ee
                  link
                  fedilink
                  English
                  arrow-up
                  2
                  arrow-down
                  1
                  ·
                  1 year ago

                  The difference is that we now can do video. I mean in principle that was possible before but also a hell of a lot of work. Making it look real hasn’t been a problem since before Photoshop, if anything people get sloppy with AI also because a felt 99% of people who use AI don’t have an artistic bone in their body.

                • jivandabeast@lemmy.browntown.dev
                  link
                  fedilink
                  English
                  arrow-up
                  1
                  ·
                  1 year ago

                  I’m not saying that it’s a shift in nature? All I’ve been saying is:

                  A) tools to create realistic nudes have been publicly available ever since deepfakes became a thing

                  B) deepfakes are worse than traditional photoshopped nudes because (as you put it, a quality improvement) they’re more convincing and therefore can have more detrimental effects

              • lolcatnip@reddthat.com
                link
                fedilink
                English
                arrow-up
                4
                ·
                1 year ago

                There was a brief period between now and the invention of photography when that was true. For thousands of years before that it was possible to create a visual representation of anything you imagine without any hint that it wasn’t something real. Makes me wonder if there were similar controversies about drawings or paintings.

        • NeoNachtwaechter@lemmy.world
          link
          fedilink
          English
          arrow-up
          1
          arrow-down
          2
          ·
          1 year ago

          And you are sure that ‘someone’ is of legal age, of course. Not blaming you. But does everybody always know that ‘someone’ is of legal age? Just an example to start thinking.

          • chitak166@lemmy.world
            link
            fedilink
            English
            arrow-up
            8
            arrow-down
            3
            ·
            1 year ago

            I don’t know if it’s illegal to create naked drawings of people who are underage.

            • andros_rex@lemmy.world
              link
              fedilink
              English
              arrow-up
              2
              arrow-down
              1
              ·
              1 year ago

              Depends on where you live. Not legal in the UK for example. In the US it can even be broken down at the state level, although there’s lots of debate on whether states are able to enforce their laws. “Obscene” speech is not protected under free speech, the argument would be whether or not the naked drawings had artistic merit or not.

              I’m not a lawyer, but I do know that people in the US have gone to prison for possessing naked images of fictional children and it’s on the books as illegal in many other countries.

        • Tyfud@lemmy.one
          link
          fedilink
          English
          arrow-up
          2
          arrow-down
          3
          ·
          1 year ago

          It’s what the courts think, and right now, it’s not clear what the enforceable laws are here. There’s a very real chance people who do this will end up in jail.

          I believe prosecutors are already filling cases about this. The next year will decide the fate of these AI generator deepfakes and the memories behind them.

  • ???@lemmy.world
    link
    fedilink
    English
    arrow-up
    24
    arrow-down
    1
    ·
    1 year ago

    They can go ahead, but they’ll never get that mole in the right place.

  • Tylerdurdon@lemmy.world
    link
    fedilink
    English
    arrow-up
    31
    arrow-down
    13
    ·
    1 year ago

    You mean men envision women naked? And now there’s an app that’s just as perverted? Huh

    • lolcatnip@reddthat.com
      link
      fedilink
      English
      arrow-up
      14
      arrow-down
      2
      ·
      1 year ago

      What’s perverted about someone envisioning a potential sexual partner naked? That seems incredibly normal to me.

  • Corkyskog@sh.itjust.works
    link
    fedilink
    English
    arrow-up
    16
    arrow-down
    4
    ·
    1 year ago

    What nude data were these models trained on?

    This seems like another unhealthy thing that is going to pervert people’s sense of what a normal body looks like.

    • chitak166@lemmy.world
      link
      fedilink
      English
      arrow-up
      6
      arrow-down
      3
      ·
      1 year ago

      Most people prefer attractive > average, so I guess that’s what these apps are going to show.

  • damnfinecoffee@lemmy.world
    link
    fedilink
    English
    arrow-up
    11
    ·
    1 year ago

    Reminds me of Arthur C Clarke’s The Light of Other Days. There’s a technology in the book that allows anyone to see anything, anywhere, which eliminates all privacy. Society collectively adjusts, e.g. people masturbate on park benches because who gives a shit, people can tune in to watch me shower anyway.

    Although not to the same extreme, I wonder if this could similarly desensitize people: even if it’s fake, if you can effectively see anyone naked… what does that do to our collective beliefs and feelings about nakedness?

    • flamehenry@lemmy.world
      link
      fedilink
      English
      arrow-up
      12
      ·
      1 year ago

      It could also lead to a human version of “Paris Syndrome” where people AI Undress their crush, only to be sorely disappointed when the real thing is not as good.

    • PopOfAfrica@lemmy.world
      link
      fedilink
      English
      arrow-up
      16
      ·
      1 year ago

      Obviously not defending this, I’m just not sure how it wouldn’t be legal. Unless you use it to make spurious legal claims.

      • cosmicrookie@lemmy.world
        link
        fedilink
        English
        arrow-up
        11
        arrow-down
        4
        ·
        1 year ago

        I live in a Scandinavian country, and it is illigal to make and distributed fake (and real) nudes of people without their permission. I expect this to be the same in many other developed countries too.

        • hansl@lemmy.world
          link
          fedilink
          English
          arrow-up
          4
          ·
          1 year ago

          I’m curious. If I was to paint you using my memory, but naked, would that still be illegal? How realistic can I paint before I trespass the law? I’m fairly sure stick figures are okay.

          And do you mean that even just possessing a photo without consent is illegal? What if it was sent by someone who has consent but not to share? Is consent transitive according to the law?

          AI pushes the limit of ethics and morality in ways we might not be ready to handle.

          • cosmicrookie@lemmy.world
            link
            fedilink
            English
            arrow-up
            2
            arrow-down
            1
            ·
            1 year ago

            I am pretty sure that possesion is not illigal but that distribution without consent is. The idea is that someone can have sent you their nude, but you’d get charged if you share it with others.

            There was a huge case here, where over 1000 teens were charged for distributing child porn, because of a video that cirvulated among them of some other teens having sex. So basically someone filmed a young couple having sex at a party i believe. That video got shared on Facebook messenger. Over 1000 teens got sued. I believe that 800 were either fined or jailed

            Here’s an article you may be able to run through Google translate

            https://jyllands-posten.dk/indland/ECE13439654/naesten-500-doemt-for-boerneporno-i-kaempe-sag-om-unges-deling/

            • Encrypt-Keeper@lemmy.world
              link
              fedilink
              English
              arrow-up
              3
              ·
              1 year ago

              In some states, distributing nude content of anyone, including one’s self, with consent, electronically is illegal. Which sounds insane because it is. It’s one of those weird legacy laws that never ever never gets enforced for obvious reasons, but I actually know a guy arrested for it, because he got in the wrong side of some police and it was just the only law they could find that he “broke”.

      • cosmicrookie@lemmy.world
        link
        fedilink
        English
        arrow-up
        7
        arrow-down
        4
        ·
        1 year ago

        But its not. That is not legal.

        I dont know if it is where you live, but here (Scandinavian Country) and many other places around the World, it is illigal to create fske nudes of people without their permission

        • Daxtron2@startrek.website
          cake
          link
          fedilink
          English
          arrow-up
          5
          ·
          1 year ago

          Ah didn’t know that, AFAIK it’s protected artistic speech in the US. Not to say that it’s right but that’s probably why it’s still a thing.

          • barsoap@lemm.ee
            link
            fedilink
            English
            arrow-up
            2
            ·
            1 year ago

            In principle that’s the case in Germany, too, but only if the person is of public interest (otherwise you’re not supposed to publish any pictures of them where they are the focus of the image) and, secondly, it has to serve actually discernible satire, commentary, etc. Merely saying “I’m an artist and that’s art” doesn’t fly, hire a model. Similar to how you can dish out a hell a lot of insults when you’re doing a pointed critique, but if the critique is missing and it’s only abuse that doesn’t fly.

            Ha. Idea: An AfD politician as a garden gnome peeing into the Bundestag.

        • TotallynotJessica@lemmy.world
          link
          fedilink
          English
          arrow-up
          3
          arrow-down
          1
          ·
          1 year ago

          Appreciate how good you have it. In America, child sex abuse material is only illegal when children were abused in making it, or if it’s considered obscene by a community. If someone edits adult actors to look like children as they perform sex acts, it’s not illegal under federal law. If someone generates child nudity using ai models trained on nude adults and only clothed kids, it’s not illegal at the national level.

          Fake porn of real people could be banned for being obscene, usually at a local level, but almost any porn could be banned by lawmakers this way. Harmless stuff like gay or trans porn could be banned by bigoted lawmakers, because obscenity is a fairly subjective mechanism. However, because of our near absolute freedom of speech, obscenity is basically all we have to regulate malicious porn.

          • CaptainEffort@sh.itjust.works
            link
            fedilink
            English
            arrow-up
            1
            ·
            1 year ago

            child sex abuse material is only illegal when children were abused in making it

            This is literally why it’s illegal though. Because children are abused, permanently traumatized, or even killed in its making. Not because it disgusts us.

            There are loads of things that make me want to be sick, but unless they actively hurt someone they shouldn’t be illegal.

          • cosmicrookie@lemmy.world
            link
            fedilink
            English
            arrow-up
            1
            ·
            edit-2
            1 year ago

            The way I believe it is here, is that it is illigal to distribute porn or nudes without consent, be it real or fake. I don’t know how it is with AI generated material of purely imaginary people. I don’t think that that is iligal. but if it is made to look like someone particular, then you can get sued.

    • phoneymouse@lemmy.world
      link
      fedilink
      English
      arrow-up
      5
      ·
      1 year ago

      I guess free speech laws protect it? You can draw a picture of someone else nude and it isn’t a violation of the law.