Do we need marketing mix modeling or a paid multi-touch attribution tool?
Our answer
The answer depends on spend.
Let lift and holdout tests decide where budget goes. Add a paid attribution tool once you run several channels, and a test-calibrated marketing mix model (MMM) to split budget across many channels.
Below about $200K a month, skip a paid marketing mix model and judge Meta on its reporting, store sales and periodic lift tests. Add a paid attribution tool from about $50K to $100K a month across two or more channels.
Why this is the answer
3 reasons and our judgmentA paid attribution tool earns its place when you need every channel read on one basis. HexClad calls Northbeam the backbone of its media buying for that reason, though the newsletter marks Northbeam as a sponsor of its podcasts.
Match the tool to the decision. Grüns, a supplement brand, uses tests and an MMM for big budget calls and attribution for daily moves.
Brands that grew on Meta should start with tests inside Meta, as HexClad's Connor Rolain advises. Olivia Kory of Haus, an incrementality testing platform, argues that a Meta holdout also helps tune an MMM.
Our judgment
We set the trigger for a paid attribution tool at several channels, and we hold that a mostly-Meta brand can rely on tests plus Meta's reporting. That draws on HexClad's reason for Northbeam (every channel on one basis), Connor Rolain's advice to start with tests inside Meta, Flighted's view that Meta-only brands with same-day purchase cycles suit incrementality tests and Eightx's MMM range of 3 to 5 or more channels. Checking attribution against holdouts before moving large sums draws on Grüns, which uses test results to put attribution in context.
Our judgment, built from HexClad, Connor Rolain (HexClad), Flighted, Eightx and Grüns: our reading of these sources, not a finding from any one of them.
What the sources say
15 statements from 12 sourcesBoathouse's strategy chief says that for one client an off-the-shelf mix model credited paid media with about 75% of new customers, while a custom model on the same data said under 1%. Check models with lift tests.
“A result below 1% deserves as much scrutiny as a result of 75%.”
Triple Whale, comparing itself with Haus, says its plans start at $219 a month, its attribution leans on post-purchase surveys, and its weekly mix model uses test results as priors. It gives no data.
“starts at $219/mo (Foundation); pricing varies by annual GMV.”
AdAdvisor, a seller of an AI media-buying agent, says to start with Conversion Lift or GeoLift, and move to an experiment-calibrated mix model only with two or more years of data or many channels.
“A team with no MMM but two well-designed lift tests a year will likely make better Meta budget decisions than a team with an uncalibrated MMM and no tests.”
Gruns' growth head matches the tool to the decision: incrementality tests, a mix model and marginal return for big budget calls, and attribution and platform data for daily moves.
“I'm also not letting attribution decide whether Meta deserves another $500K.”
HexClad's Connor Rolain says AppLovin reaches the most new customers for HexClad: holdouts plus Northbeam showed 90% new customers, 36% higher ROAS and 27% lower CAC. The post carries an AppLovin credit offer.
“Which channel will help me reach the most new customers?”
In this episode HexClad's Connor Rolain suggests a mature Meta-led brand start with tests inside Meta and save holdouts for new channels; Haus's Olivia Kory says a Meta holdout helps calibrate a mix model.
Connor Rolain says brands should not start with turning off their hero channel entirely, and should first run directional holdouts inside the hero channel.
“I think you should actually start with those like directional tests inside of your hero channels.”
Connor MacDonald says one-off incrementality ROAS reads per channel are less useful than running incrementality tests as A/B tests that compare channels.
Connor Rolain argues brands should start with directional testing inside Meta to get the most from it, then move to channel-wide holdouts when expanding into YouTube or CTV.
“start with those like directional tests inside of your hero channels”
HexClad uses Northbeam to compare channels on one basis regardless of each platform's attribution, runs geo holdout tests with Haus, and keeps a mix model.
“the backbone of our media buying decisions”
Flighted says a mix model fits brands spending $50K+ a month across 3 or more channels, while Meta-only brands with same-day purchases do better with incrementality tests.
“spending $50K+/month across channels”
Ridge's CEO says he starts every day in Northbeam and has used it since launch, but notes Northbeam sponsors his podcast and tells listeners not to trust him.
“So don't trust me.”
Eightx says Northbeam needs at least $50K a month in paid media for reliable signal, that all-in attribution cost should stay under about 2% of spend, and that the premium is justified above $150K a month.
“Above $150K/month, Northbeam's attribution accuracy starts to defend the premium”
Skullcandy's ecommerce head says a sophisticated multi-touch model is not the answer; he uses incrementality studies and an attribution layer to make the business case to finance.
“I don't think the solve is having some sophisticated like multi-touch attribution model”
Eightx puts the mix model adoption floor near $20M+ revenue and $3M to $5M+ a year in media across 3 or more channels; under $1M, use platform reports plus quarterly incrementality tests.
“The adoption floor for DTC is roughly $20M+ in revenue and $3M-$5M+ in annual media spend”
In the full answer
For readers who sign in- What to do this week3 steps
- The numbers behind it2 figures from cited sources
- Where each source standsA chart placing each source on the question
- The strongest disagreementThe best case against the answer, from a cited source
- How sure we areWhat its confidence rests on, and what would change the answer