Experienced Marketers Picked the Winning Message Only 33% of the Time
Persado and Momentive surveyed more than 250 experienced retail marketing leaders and asked a deceptively simple question: given three versions of a real campaign message — one human-authored control, one median-performing AI variant, and one highest-performing AI variant — which one would you send? On average, respondents picked the highest performer only 33% of the time as individuals, and 30% of the time collectively.
The twelve campaigns used in the survey were drawn from more than 2,000 real retail campaigns that ran on the Persado platform between November 2021 and December 2022, each seen by thousands to millions of real consumers.
What the 2023 Digital Marketer Survey Revealed
The gap between marketer intuition and real-world campaign performance was wider — and more expensive — than the survey's designers predicted.
- 33% hit rate on the winning message: On average, individual marketers picked the highest-performing message only 33% of the time. Collectively, the group picked it 30% of the time. The original hypothesis had been 50%.
- 68% engagement uplift left on the table: Across the twelve campaigns, human-authored control messages averaged a 1.49% click rate. The highest-performing AI variants averaged 2.5% — a 68% engagement uplift.
- $5.8M in incremental revenue from the experimental phase alone: For the twelve campaigns in the survey, the highest-performing variants produced $5.8 million in incremental revenue during testing. Going with the marketer's intuitive choice would have left that on the table.
- Holiday campaigns were hardest: On one Black Friday 2021 campaign, marketers picked the highest performer only 17% of the time — and 41% would have shipped the control. The winning message drove $135,000 in incremental revenue from less than 1% of the audience.
- Even AI practitioners get surprised: Persado's own content-intelligence linguists — who work with the platform daily — report being regularly surprised by which variant wins, reinforcing that no amount of individual experience substitutes for real-world performance data.
Human Creativity Plus AI Plus Real-World Data — Not Any One of the Three Alone
The report's central argument is not that AI replaces human marketers. Experienced creatives are essential for analysing customer data, ideating campaigns, and crafting copy that sounds like the brand. What the survey shows is that human intuition alone — even from senior marketing leaders — cannot reliably predict which variant will win in market. Markets change, consumer behaviour shifts, and even a campaign written two months ago can underperform when it hits today's audience.
The practical implication for CMOs is to design a workflow where human creative, AI-generated language variants, and real-time performance data all contribute to the final call. Brand voice and consistency remain the marketer's responsibility — but the choice between equally on-brand variants should be made by the data, not by instinct. Persado's platform has cumulatively delivered over $1.5 billion in incremental revenue for brands including Ally Bank, Dropbox, JPMorgan Chase, Marks & Spencer, and Verizon through exactly this kind of yes-and workflow.
Download the full survey for the methodology, the complete campaign examples, and the full breakdown of marketer response patterns.
