Overstating the power of algorithmic systems only serves to benefit the tech companies behind them.

Excerpt:

To underline Blanchfield’s point, the ChatGPT book selection process was found to be unreliable and inconsistent when repeated by Popular Science. “A repeat inquiry regarding ‘The Kite Runner,’ for example, gives contradictory answers,” the Popular Science reporters noted. “In one response, ChatGPT deems Khaled Hosseini’s novel to contain ‘little to no explicit sexual content.’ Upon a separate follow-up, the LLM affirms the book ‘does contain a description of a sexual assault.’”

  • dfyx@lemmy.helios42.deEnglish
    32·
    1 年前

    When will people learn that LLMs have no understanding of truth or facts? They just generate something that looks like it was written by a human with some amount of internal consistency while making baseless assumptions for anything that doesn’t show up (enough) in their training set.

    That makes them great for writing fiction but try asking ChatGPT for the best restaurants in a small town. It will gladly and without hesitation list you ten restaurants that have never existed, including links to websites that may belong to a completely different restaurant.

    • money_loo@1337lemmy.com
      4·
      1 年前

      I basically agree with you but for your example that’s because ChatGPT wasn’t made to return local results, nor even recent ones.

      So of course it’s going to fail spectacularly at that task. It has no means to research it.

  • The Doctor@beehaw.orgEnglish
    17·
    1 年前

    The point isn’t that they used ChatGPT to pick books to ban. They may not have even used ChatGPT, they just said they did so they can point to a service and say “See? It wasn’t us, it was that!”

    They’ve shown time and again that they lie. That they do not act or argue in good faith. That they make excuses to distract people from what they’re doing.

    Stop treating these assholes as if debating them will do a damned thing. We’re playing checkers, but they’re fighting an MMA match.

    • jamesravey@lemmy.nopro.beEnglish
      7·
      1 年前

      This is as transparent as hell. It reminds me of a TV show where a bunch of idiots plot to murder someone so they decide that if they all pull the trigger together, none of them are “technically” the murderer. Of course, that just meant they were all culpable.

      It’s only a few layers of abstraction above “we didn’t ban these books, we flipped a coin to decide whether to ban them and fate chose tails…”

      Pathetic.

    • buckykat@lemmy.blahaj.zone
      3·
      1 年前

      Lots of uses of “AI” are so people can deny responsibility. They feed in their history of discrimination, tell the machine to replicate it, then go, “it can’t be discriminatory, it’s an AI”

  • drifty@sopuli.xyzEnglish
    9·
    1 年前

    As a non American I absolutely do not care. How do I make content like this not show up on my feed without unsubscribing to Tech Beehaw?

    • money_loo@1337lemmy.com
      5·
      1 年前

      I mean I’m American and I’ve been looking for a technology community that actually posts cool and fun tech stories instead of apparently assuming every bit of tech is the anti-Christ incognito.

      If anyone happens to find one let me know, because I feel like the only people that care enough to post here, care in the wrong direction and fucking hate all things technology.

        • Five@beehaw.orgOP
          5·
          1 年前

          So many questions!

          Are you suggesting that the political aspects of technology shouldn’t be discussed in a technology community?

          Are you implying that technology is apolitical? That there are technology subjects to discuss that don’t have a political component?

          Do discussions of the applications of technology not belong in a technology community?

            • Five@beehaw.orgOPEnglish
              2·
              1 年前

              The guy you’re trying to pass the buck to, money_loo, is from a lemmy instance that only has Chicago sports communities and whose front page is mostly federated meme posts. You’re a BeeHaw user. You’ve presumably read and agreed to the Beehaw community documents.

              I expect more than anti-intellectualism from you.

        • money_loo@1337lemmy.com
          3·
          1 年前

          I’ve been here a month now and that doesn’t seem to stop them, lol. At one point I was subbed to like five different tech communities, and I had to unsubscribe from three so far. This one is getting closer everyday.

  • Steeve@lemmy.ca
    7·
    1 年前

    This headline is garbage. Not only is it stating something that I haven’t heard anyone seriously argue, it has nothing to do with the rest of the article, which just goes on to talk about how shitty a job ChatGPT is doing at the task.

    • Adramis [he/him]@beehaw.org
      9·
      1 年前

      There was literally an article either yesterday or the day before with the headline “AI being used to ban books in Iowa” or something to that effect.

      • Steeve@lemmy.ca
        5·
        1 年前

        Republicans are using AI to ban books is very different than saying AI is banning books. Nobody is saying “AI is banning books”

        • dax@beehaw.orgEnglish
          2·
          1 年前

          I mean, this is near enough as makes no difference, I think?

          Either way I won’t have to look at his trash-ass takes anymore, but I’m just saying it does exist and when you run across a take like that, it tends to taint everything near it.

    • chameleon@kbin.social
      5·
      1 年前

      The argument does exist. This article by PEN America is one of the most widely spread ones and largely misrepresents the situation. It’s based on a PopSci article with a similar headline, though the contents of the article tell a rather different story.

      Nothing really says out loud what’s going on: Republicans enacted an extremely vague and unrealistically short deadline book ban as part of a bill (that does some other stuff like removing AIDS education), forcing schools to either throw out every book that might be vaguely suspect or resort to funny measures like this. This school’s use of ChatGPT was purely to save books that were on a human-assembled list of challenged books, to reduce the negative effect of the book ban, while being potentially defensible in court (remains to be seen how that’ll work out, but they made an “objective” process and stuck to it - that’s what matters to them).