How should we set budgets for awareness channels that are hard to measure?
Our answer
Treat a hard-to-measure awareness channel as a test sized to show up in total sales. Start it once your measurable channels work, and keep it only if the test shows sales it adds.
- Confidence
- Medium
- Strongest proof
- 2 controlled tests
- 5 datasets, 9 practitioners, 8 opinions or claims
- Sources
- 20 sources
- 24 statements
New here? Take the 1-minute tour
Why this is the answer
3 reasons and our judgmentSmall tests often show nothing. Measured, an incrementality testing firm, advises sizing a test with a power analysis rather than a round number. It found small connected TV and audio tests often failed to register measurable incremental sales.
A readable test takes real money. Eightx, a fractional CFO firm, puts an 8-figure consumer brand's 90-day connected TV test at $90K to $200K and advises picking the measurement first. Jetfuel Agency says a clean 60 to 90 day test needs a five-figure budget.
Brand spend comes after direct response works. Drew Fallon, who sees the books of about 200 brands, says brand spend gets funded only once direct response is efficient enough to pay for it.
Our judgment
- Set the awareness budget as a test sized to be read, not as a fixed share. Measured found sub-scale connected TV and audio tests often failed to register and calls 60:40 a population average. Eightx and Jetfuel Agency put a readable test at a five-figure sum or more over about 90 days.
- Start only once measurable channels work and are running short of room. This joins Drew Fallon's view on funding brand spend, Les Binet's point that newer brands may lean on activation first, Eightx's saturation gates and Adwave's advice to fix the funnel first.
- Once a channel passes its test, protect it from cuts made on last-click reports. Fospha's top-quartile brands held at least 20% in awareness and consideration every quarter, and Les Binet warns against cutting media blindly.
- Fund the first test from a set-aside of about 5 to 10% of spend. This follows Hallam's test-and-learn budget and Mark Sansum's suggested shift.
Our judgment, built from Measured, Eightx, Jetfuel Agency, Drew Fallon, Les Binet, Adwave, Fospha, Hallam and Mark Sansum: our reading of these sources, not a finding from any one of them.
What the sources say
24 statements from 20 sourcesRuggable's CMO says it moved about 10% of marketing spend from performance channels like Meta into influencers and CTV, including over $1 million into ShopMy creators. No cost or return figures are given.
“what got us here is not going to get us there”
Drew Fallon, who sees the books of about 200 brands mostly at $20M to $300M revenue, says most do not start brand spending until past $30M revenue, and only once direct response can pay for it.
“brand spend only gets funded once direct response is efficient enough to pay for it”
Haus says about half of YouTube tests are built to detect lifts under 4%, and brands that missed a benchmark on a first test beat it on the retest 44% of the time, so one test is not a verdict.
“one test is a read, not a verdict.”
Sahan Jeyaseelan says small brand awareness budgets, such as $15K to $20K a month, are a trap for fast-growing brands because they cannot build enough frequency to matter.
“You're not going to become Coca Cola with your 20k a month, 15k a month brand awareness budget.”
MillionPodcasts, which sells a podcast database, says a single-location business should sponsor one local show for a month and give every show its own code or number. Spotify Ads Manager campaigns start at $250.
“Never let two shows share one code word or number.”
Measured's CTV panel, over $25M of spend, found streaming about 75% more incremental than linear TV and YouTube CTV and video at 1.6x the category benchmark. Small-budget CTV tests often showed no measurable lift.
“the platform is rarely the variable that decides the outcome”
Measured's panel of 269 expansion-channel programs put Snapchat at 1.9x the panel's incrementality average, with conversion buys far ahead of awareness buys. It says to size tests with a power analysis.
“Size the test with a power analysis, not a round number.”
Measured's panel of channels tested after Google and Meta indexed AppLovin at 2.0x the panel's average incremental return, among the strongest channels in the panel.
“AppLovin prospecting proved genuinely incremental at multiple brands, not just retargeting.”
New Public Media, an agency, gives each podcast show its own promo code and vanity URL and lists each by name in a buyer survey. In its accounts, survey plus code data recovers 20 to 35 percent more revenue than pixels.
“run a 60 day geo holdout, keeping two comparable metros unexposed, to separate incremental revenue from orders you would have received anyway.”
Fospha, which sells measurement, says brands in the top quartile for Q4 ROAS in its client data kept at least 20% of funnel budget in awareness and consideration every quarter. It is a pattern, not a test.
“a benchmark from that client base, not a fixed rule for every business”
Jetfuel, an agency, says Meta stays more efficient and CTV earns a test once social and search stop scaling. A clean 60 to 90 day test usually needs a five-figure budget, read with a holdout or geo test.
“Meta stays the more efficient direct-response channel. CTV earns a test once social and search stop scaling.”
Measured, which sells incrementality tests, calls the 60/40 brand split a population average. Test the biggest lower-funnel lines, like branded search and retargeting, first and move non-incremental spend upstream.
“But it is a population average, not your answer.”
CTC's Luke Austin weighs a new channel's staff and measurement cost against the 2 to 5% of mix it will likely hold, and says cheaper geo testing now justifies $15 to 20K channel tests.
Marketing Interactive reports Les Binet says advertising ROI has risen 4% since Covid while incremental profit fell 11%, and the best split is usually about 60% brand and 40% activation, varying by category.
“Newer brands may need to lean more heavily into activation first, while mature brands generally need a stronger brand weighting.”
B&T reports Les Binet's research found budget drives profit eight or nine times more than ROI, yet few brands test budget levels. Most do best with roughly 60:40 brand to performance.
“The main driver of profit is not ROI, it’s the budget by a factor of eight or nine to one.”
Eightx, a CFO firm, says CTV pays for DTC beauty brands only once Meta and Google saturate and a measurement plan is set. Below $15M revenue it rarely works, and a 90-day test costs $90K to $200K.
“Decide on a measurement approach before the first dollar of media.”
DataLatte, a local marketing consultant, says a local business needs at least $5,000 a month for 3+ months to see CTV results, should skip it under 50,000 households, and should pick Facebook first.
“Skip CTV if you're in a rural area with under 50,000 households.”
Amsive's geo holdout guide shows how more control cities lower the minimum detectable lift (4 cities 21.5%, 12 cities 13.0% over 17 weeks), and suggests 4 to 8 weeks minimum with 20 or more markets per arm.
“A test with a short pre-period produces a number that looks like a lift estimate but isn’t one.”
Adwave, which sells self-serve TV ads, puts a first local CTV test at $800 to $1,500 a month for 8 weeks in one market, judged against a pre and post baseline after 60 to 90 days.
“Four weeks of pre-launch data is the minimum. Six weeks is better.”
WIFM, a local radio station, tells local advertisers to ask every customer how they found them, use a dedicated phone number and web address, and compare calls and visits with their normal baseline.
“The biggest mistake is judging too soon.”
Rockerbox's Bonafide Health case: a TV and CTV test in 7 markets showed positive brand lift but revenue more modest than expected. Amazon sales rose double digits, retail and direct-to-consumer only modestly.
A paid media agency founder writing in Search Engine Journal calls the 60/40 split a rough start and suggests keeping 20 to 30% of paid search and social reaching new cold audiences. He shows no data.
“If uncertainty is high, start by allocating a modest portion (say +5-10% shift) of your budget to upper-funnel campaigns for a period, then measure results.”
Hallam, a UK agency, says from client experience that protecting 20 to 40% of paid media for demand creation tends to lower long-term CPAs, and plans should hold 5 to 10% for testing. It shows no data.
“channels that create demand rarely look efficient in isolation.”
Haus's five-week geo test of Skylight's linear TV lifted total orders 8.6%: 5.3% on its own site and 11.2% on Amazon. Cost per incremental order was slightly above goal.
In the full answer
For readers who sign in- What to do this week3 steps
- The numbers behind it3 figures from cited sources
- Where each source standsA chart placing each source on the question
- The strongest disagreementThe best case against the answer, from a cited source
- What the research saysWhat academic research adds, kept apart from the answer
- How sure we areWhat its confidence rests on, and what would change the answer