Study: People Prefer AI Stories and Can't Tell Them Apart — SkimNews
Get the Tech newsletter
Daily tech — startups, AI labs, chips, the launches that shape the next decade. Free.
- Sydney Sears and Deena Weisberg at Villanova University had 1,682 US-representative adults read either an AI-generated story (via ChatGPT 4.0) or one sourced from a literary journal; AI stories scored 1.54 vs 0.97 for human ones on a quality scale ranging from -3 to 3.
- AI-generated stories were also rated more absorbing, averaging 1.42 vs 1.0 for human-written ones, with every story rated slightly higher when participants were told it was human-written regardless of actual origin.
- Follow-up identification tests found participants performed no better than chance at distinguishing AI from human writing — 39% correct in the first test and 52% in the second, with researchers suggesting society may be adapting to recognize AI output.
- Claire Hardaker at Lancaster University said people are grappling with being "no better than robots" at writing short stories, and that being tricked by AI-generated music angers people more than any other form.
- Rodney Jones at the University of Reading suggested the preference may reflect researchers sourcing stories from literary journals rather than accessible genres, and that ChatGPT likely produced simpler, easier-to-read content by default.
- Cultural backlash persists: a Commonwealth prize short story in Granta was accused of being AI-generated (investigation inconclusive), and artists criticized Christie's auction of AI-generated art as "mass theft."
Why it matters: The study suggests AI-generated writing now matches or beats human literary output in reader preference, with readers performing at chance (39-52%) when asked to distinguish the two. That finding collapses a key argument against AI in creative fields and forces literary prize committees, publishers, and educators to confront a technology whose output is functionally indistinguishable from human work — even as the researchers themselves note AI may simply produce easier, "vanilla" content.
Ask SkimNews
