Get your free personalized podcast brief

We scan new podcasts and send you the top 5 insights daily.

A New York Times blind taste test revealed that readers preferred AI-generated passages over human-written ones in literary fiction, fantasy, and science writing. This suggests AI has surpassed a critical quality threshold, moving beyond factual summarization to excel in nuanced, creative domains traditionally dominated by humans.

Related Insights

In the age of AI, the new standard for value is the "GPT Test." If a person's public statements, writing, or ideas could have been generated by a large language model, they will fail to stand out. This places an immense premium on true originality, deep insight, and an authentic voice—the very things AI struggles to replicate.

As AI democratizes the technical aspects of content creation, the ability to guide it with unique perspective, craft, and taste becomes the key differentiator. AI is a powerful tool for experts to scale their vision, but it cannot replace the vision itself.

Historically, well-structured writing served as a reliable signal that the author had invested time in research and deep thinking. Economist Bernd Hobart notes that because AI can generate coherent text without underlying comprehension, this signal is lost. This forces us to find new, more reliable ways to assess a person's actual knowledge and wisdom.

Earlier AI models would praise any writing given to them. A breakthrough occurred when the Spiral team found Claude 4 Opus could reliably judge writing quality, even its own. This capability enables building AI products with built-in feedback loops for self-improvement and developing taste.

In an experiment, a professional writer's colleagues couldn't reliably distinguish his satirical column from an AI-generated one. Some even preferred the AI's version, calling it more coherent or closer to his style, revealing AI's startling ability to mimic and even improve upon creative human work.

When an Economist writer pitted his own satirical column against one generated by AI, several colleagues mistakenly identified the AI's version as his. They found the AI's writing more coherent and, in some cases, more representative of his style, highlighting AI's shocking proficiency in creative and nuanced tasks.

While GenAI continues the "learn by example" paradigm of machine learning, its ability to create novel content like images and language is a fundamental step-change. It moves beyond simply predicting patterns to generating entirely new outputs, representing a significant evolution in computing.

AI will automate the creation of first drafts, which are often based on existing ideas. This shifts the value from initial creation to refinement. The editor, who curates and improves the AI's output, will become more critical and valued than the writer who once created from scratch.

The best AI models are trained on data that reflects deep, subjective qualities—not just simple criteria. This "taste" is a key differentiator, influencing everything from code generation to creative writing, and is shaped by the values of the frontier lab.

Contrary to fears that AI averages out creativity, it can act as a partner to challenge a writer's habitual thinking, suggest alternative phrasings, and identify blind spots, ultimately leading to more original output.

AI-Generated Writing Is Now Preferred Over Human Authors in Creative Genres | RiffOn