Should we run a post-purchase survey, and how much weight should it get against Meta's own reporting?
Our answer
Run a one-question post-purchase survey and read it beside Meta's reporting as a second check. Give it an answer for every channel you pay for. Let lift tests, not the survey, decide Meta's budget.
- Confidence
- Medium
- Strongest proof
- 6 practitioners
- 2 opinions or claims
- Sources
- 7 sources
- 8 statements
- H
CPRDN
New here? Take the 1-minute tour
Why this is the answer
3 reasons and our judgmentBrands that run holdout tests also run a survey beside them. HexClad asks buyers where they heard about it, how long they knew it and which competitors they use, next to Haus holdouts and a mix model (Connor Rolain). Ridge does the same (Sean Frank).
A survey is an independent check on platforms grading their own work. Cody Plofker finds in-platform attribution directionally helpful but makes the survey his first outside check, and he holds up incrementality testing as the best measure.
The survey catches what the pixel misses, because pixels credit the last touch, argues Fairing, a post-purchase survey software maker. It claims 4 out of 5 brands it audited were missing a real investment from their answer list.
Our judgment
We read the survey beside Meta's reporting and let lift or holdout tests settle disagreements, rather than fixing a weight. That combines HexClad, Cody Plofker and Ridge, each of which runs a survey beside other measures. It fits the measurement answers that make tests the judge of budget (Marketing mix models and attribution tools) and keep Meta's reporting for comparisons inside Meta (Reconciling Meta with GA4 and store totals). We also keep an answer for every channel you pay for and add each new channel by the time its ads launch. Fairing finds new podcasts and creators are usually added after launch and sometimes never, a timing that rests on its audits rather than a test.
Our judgment, built from HexClad, Cody Plofker, Ridge and Fairing: our reading of these sources, not a finding from any one of them.
What the sources say
8 statements from 7 sourcesA guest on The DTC Podcast starts post-purchase surveys with easy questions such as gender and age bracket, and reports a 75% completion rate on an eight-question survey.
“you start with something that you do know. What's your gender?”
An Operators podcast speaker treats about 35% of buyers saying they heard of the brand from a friend as a health check: if it drops below that, he is overspending on paid.
“That to us has always been like, if it drops below that, I'm spending too much money unpaid.”
Triple Whale, comparing itself with Haus, says its plans start at $219 a month, its attribution leans on post-purchase surveys, and its weekly mix model uses test results as priors. It gives no data.
“starts at $219/mo (Foundation); pricing varies by annual GMV.”
A survey vendor's CEO says a post-purchase survey catches buyers the pixel misses, since pixels credit the last touch, usually search or direct. Its other claims come with no sample or method.
“the post-purchase survey catches what the pixel can't”
Cody Plofker's first independent check on TV is the post-purchase survey, scaled up by the response rate (if half of buyers answer, double it), then compared with other attribution models.
“never allow anyone to create their own homework”
HexClad's Connor Rolain says its post-purchase survey, run through Kno, asks where buyers heard of the brand and feeds daily decisions, alongside Haus geo tests and a mix model. No figures compare it with Meta.
“These insights contribute to our day-to-day decision-making.”
HexClad uses Northbeam to compare channels on one basis regardless of each platform's attribution, runs geo holdout tests with Haus, and keeps a mix model.
“the backbone of our media buying decisions”
Sean Frank, CEO of Ridge, rates his own post-purchase survey tool KNO 3 out of 5, saying surveys have not evolved much. He says Haus would be 5 stars but is only for big brands.
“Would have 5 stars, but it is only for the big boys.”
In the full answer
For readers who sign in- What to do this week3 steps
- The numbers behind it2 figures from cited sources
- The strongest disagreementThe best case against the answer, from a cited source
- How sure we areWhat its confidence rests on, and what would change the answer