As AI-generated text continues to evolve, distinguishing it from human-authored content has become increasingly difficult. This study examined whether non-expert readers could reliably differentiate between AI-generated poems and those written by well-known human poets. We conducted two experiments with non-expert poetry readers and found that participants performed below chance levels in identifying AI-generated poems (46.6% accuracy, χ2(1, N = 16,340) = 75.13, p < 0.0001). Notably, participants were more likely to judge AI-generated poems as human-authored than actual human-authored poems (χ2(2, N = 16,340) = 247.04, p < 0.0001). We found that AI-generated poems were rated more favorably in qualities such as rhythm and beauty, and that this contributed to their mistaken identification as human-authored. Our findings suggest that participants employed shared yet flawed heuristics to differentiate AI from human poetry: the simplicity of AI-generated poems may be easier for non-experts to understand, leading them to prefer AI-generated poetry and misinterpret the complexity of human poems as incoherence generated by AI.
  • themoonisacheese@sh.itjust.worksEnglish
    168·
    1 month ago

    I’ll raise you one better: who the fuck wants poetry?

    Like I know I sound like a fucking mongrel who can’t appreciate art or whatever, but how many poems do you think the average person reads in their entire life? Maybe 2, for school? Poetry is just not that popular of an art form, so of course people aren’t going to be good at distinguishing good from bad. Compare it to visual arts, where people have seen multiple examples, at least more than 3 times a year for their entire life, of good visual art.

      • themoonisacheese@sh.itjust.worksEnglish
        21·
        1 month ago

        That’s cool, I’m glad you are making something you enjoy. The point stands that the average Joe doesn’t actually seek out poetry, be it man or machine-made, and will therefore be an exceptionally poor judge of a poems quality.

    • Ilovethebomb@lemm.eeEnglish
      53·
      1 month ago

      You’re right, actually. How many people make a point of reading poetry? I’ve read a huge amount, especially when I was in school, as well as news articles, and of course an unfathomable number of comments.

      Never have I decided to read poetry, not once.