How should we decide when a channel has hit diminishing returns?
Our answer
Judge the incremental return on a channel's last added spend, not its average return, against your breakeven. Find that point with tests at two or more spend levels, each sized with a power analysis.
- Confidence
- Medium
- Strongest proof
- 1 controlled test
- 2 official rules, 2 datasets, 4 practitioners, 9 opinions or claims
- Sources
- 15 sources
- 18 statements
G
New here? Take the 1-minute tour
Why this is the answer
3 reasons and our judgmentA healthy average can hide a losing last dollar. Meta cost $337 per incremental customer on average but over $1,000 on its last $80,000 (Haus). A 4 times average return can hide a marginal ROAS below 1 (WorkMagic).
Spend-level tests find the breakeven point. Haus starts with back-to-back tests at current spend and a higher level, and ATTN Agency tests cells at 25%, 50% and 100% more than current spend. Measured advises sizing a test with a power analysis, not a round number.
The breakeven cut-off comes from your margin, not from a model such as Google's Meridian. Google's Meridian sets no saturation threshold. Stella puts breakeven at 1 divided by contribution margin, so a 40% margin means 2.5 times.
Our judgment
- Judging the last added spend against breakeven is our own combination of several sources' rules. It joins Stella's breakeven formula with PMG's stop rule and the average against marginal examples from Haus and WorkMagic.
- Treat platform signals as the cue to run a spend-level test, not the verdict. The signals from Cody Plofker and Silverback Strategies are rules of thumb, and Measured and Meta's Robyn check any curve against experiments.
- Use breakeven to decide whether a channel gets more money at all, and equal marginal returns to split a fixed budget. This reconciles Stella's breakeven line with the equal marginal returns that Measured and PMG use.
- Size each spend-level test with a power analysis before you spend, and read the end of its range closest to zero. Treat a flat result from an underpowered test as no answer. Measured, Darkroom and Recast advise this for tests in general, and we apply it to tests of added spend.
Our judgment, built from Stella, PMG, Haus, WorkMagic, Cody Plofker, Silverback Strategies, Measured, Meta, Darkroom and Recast: our reading of these sources, not a finding from any one of them.
What the sources say
18 statements from 15 sourcesFunnel's measurement guide uses a made-up example: an extra $500 returning $200 has a marginal ROAS of 0.4 while blended ROAS stays near 2.13, so average ROAS hides the return on extra spend.
“Marginal ROAS on that incremental $500 is 0.4, or $0.40 per dollar.”
Meta's Robyn mix model docs say ad returns diminish, so budgets should follow the next dollar's response, and models should be calibrated with lift or geo tests. A relayed whitepaper puts uncalibrated models 25% off.
“uncalibrated models show 25% average difference to the ground truth”
PMG, an agency, says marginal ROAS, the change in revenue over the change in spend, usually falls before average ROAS does. Stop adding spend once the next dollar no longer pays back after margin.
“Stop increasing a channel when the next dollar no longer pays back.”
Stella, which sells testing, says a budget call should state direction, size and a check date, with breakeven at 1 divided by margin (a 40% margin means 2.5x). Its step-size examples are illustrative.
“Cutting a channel because the point estimate looked soft is how brands kill channels that were working.”
Measured's panel of 269 expansion-channel programs put Snapchat at 1.9x the panel's incrementality average, with conversion buys far ahead of awareness buys. It says to size tests with a power analysis.
“Size the test with a power analysis, not a round number.”
Google's Meridian assumes media has diminishing returns. Marginal ROI is the return on the next dollar, and a channel counts as saturated when it gets small, with no threshold set. Experiments can calibrate it.
“is a general term, and no specific threshold is defined.”
Silverback Strategies says lead gen brands should fund search to saturation first, then spend the next dollar on demand creation proven with lift tests of four to eight weeks, which small sellers often cannot run.
“Once demand capture is saturated, additional budget there produces diminishing returns, and the next dollar is better spent creating demand.”
Ridge's CMO says a scale-up test showed Ridge was overspending around Black Friday and getting worse MER, so more spend can lower profit even when the totals look good.
“During Black Friday, Cyber Monday, you can spend buckets of non-incremental dollars and still be happy with the outcome … just because the numbers are so big.”
Cody Plofker says the signs of diminishing returns on Meta are worsening reach, losing efficiency when you try to scale, and rising frequency.
“not able to kind of scale and so losing efficiency when you try to scale”
Darkroom, an agency, designs geo tests to detect a 5% lift with 12 to 15 markets per side, sized on your own history, and says too few markets can't be fixed by running longer. No results given.
“eight markets selected by media availability can't be fixed with a longer runtime”
Google's Meridian budget optimizer splits a fixed or flexible budget across channels, with channel spend limits to avoid results such as putting all spend in one channel.
“Channel-level spend constraints are available for both fixed and flexible budget optimization to prevent unreasonable optimization outcomes, such as putting all spend into one single channel.”
LiftLab, which sells mix models and lift tests, says geo holdouts answer keep-or-cut questions, while budget planning needs the return on the next dollar from spend-level tests. No data.
“An incrementality test without a pre-committed decision is measurement theater.”
WorkMagic, which sells geo tests and mix models, says platform ROAS includes baseline demand, misplaced halo and double counting, and that budgets should follow marginal ROAS, which can be below 1x at a 4x average.
“A channel with a healthy average ROAS of 4x can have a marginal ROAS below 1x if it's past the point of peak efficiency.”
Haus says to compare a new channel with Meta's marginal cost, not its average. In its example Meta cost $337 per incremental customer on average but over $1,000 on the last $80,000, versus $510 on YouTube.
“Yes, $80,000 netted you 76 new customers, which is a CPIA above $1,000 and well above that $510 you measured on YouTube.”
Haus suggests measuring the return on the last 25% of Meta budget with back-to-back spend-level tests first, as the cheapest option, then 3-cell holdout or stacked-spend tests.
“Dean’s recommendation for most brands: start with sequential tests, because they're the least disruptive and still get you to a meaningful answer.”
Measured, a measurement vendor, says budgets should follow marginal ROI, not average ROI. Search and retargeting show high averages but saturate quickly, and the curves must be checked with incrementality tests.
“Optimal allocation occurs when marginal ROI is equalized across all channels”
ATTN Agency says it tests budget scaling with a control at current spend against cells at 25%, 50% and 100% more, to find where returns diminish. It shows no results.
Recast says small, noisy tests that reach significance tend to overstate impact: one GeoLift read 11x ROI where a larger lift study found about 2.3x. It advises using the interval bound nearest zero.
“treat the bound of the confidence interval closest to zero as your conservative estimate”
In the full answer
For readers who sign in- What to do this week3 steps
- The numbers behind it3 figures from cited sources
- Where each source standsA chart placing each source on the question
- The strongest disagreementThe best case against the answer, from a cited source
- What the research saysWhat academic research adds, kept apart from the answer
- How sure we areWhat its confidence rests on, and what would change the answer