All answers

The Prevailing
Answers for
Business model:
Business model, pick up to two

How should we design a geo holdout test for our order volume?

The PrevailingUpdated Nov 13, 2026

Our answer

Set the pass bar at breakeven, then size the test on your daily sales by region. Use 12 or more regions per group, hold out at least 15%, run four weeks or more and measure total sales.

Confidence
Medium
Strongest proof
1 controlled test
5 official rules, 4 datasets, 4 practitioners, 12 opinions or claims
Sources
17 sources
26 statements

New here? Take the 1-minute tour

Why this is the answer

3 reasons and our judgment

A geo test needs many regions and a long, steady history. Meta's GeoLift guide asks for 20 or more regions and 4 to 5 times the test length in history. Google's GeoX asks for at least 10 regions and 3 times the test length.

Length depends on your volume. Measured, an incrementality testing firm, advises that almost no test should run under four weeks. Its table puts a 10% lift at 5 to 7 weeks with 5,000 weekly conversions and 12 or more at 1,000.

Small holdouts and early reads miss lift. Darkroom, a paid media agency, uses 12 to 15 markets per side, and Elevarus calls a holdout under 15% of regions useless. In Haus's YouTube tests 24% of the lift came after the ads stopped.

Our judgment

We pick test and holdout regions from 20 or more, with 12 or more in each group where you have them. That joins Meta's GeoLift minimum of 20 regions, Google's GeoX minimum of 10 and Darkroom's 12 to 15 per side. We measure total sales across your site, Amazon and stores rather than one storefront, because Ridge's TikTok geo test found 88% of the lift outside TikTok Shop and its AppLovin test measured Shopify and Amazon revenue together. We keep the four-week floor for most channels but accept Haus's shorter branded search reads, since Haus found a window after the test added less than 10% to branded search lift.

Our judgment, built from Meta, Google, Darkroom, Ridge, AppLovin, Haus and Measured: our reading of these sources, not a finding from any one of them.

What the sources say

26 statements from 17 sources
  • WorkMagicNov 20, 2026Caveat

    WorkMagic argues in-house geo lift tests are cheap to code but hard to do well: validate the design with a placebo test before spending, know each test's minimum detectable lift, and stress-test the readout.

    “Every geo test has a minimum detectable lift: the smallest effect it can reliably tell apart from noise. That threshold implies a budget floor.”

    Read it on workmagic.io

  • Meta's GeoLift guide recommends daily data, the finest targetable geography, at least 25 pre-test periods across 20 or more regions, history 4 to 5 times the test length, and other media held constant.

    “The test duration should cover at least one purchase cycle for the product.”

    Read it on facebookincubator.github.io

  • Common Thread CollectiveOct 20, 2026Disagrees

    CTC says that if you fear losing Black Friday sales to a test, use a user-based lift test, which withholds ads from selected shoppers rather than a whole region.

    “A user-based lift test withholds ads from selected shoppers rather than a whole region, helping estimate how many purchases would happen without the ads.”

    Read it on x.com

  • HausOct 14, 2026Supports

    In Haus YouTube geo tests, a typical 24% of lift arrived after the ads stopped, and counting that window raised typical ROI about 32%. A day after a flight, YouTube still booked about 64% of an in-flight day's lift.

    “In the typical test, 24% of the lift landed in the post-treatment window.”

    Read it on haus.io

  • CTC, which manages AppLovin ads, says that for 7 to 9 figure brands already on Meta and Google, a 2 to 3 week geo test of AppLovin-active versus holdout regions is the most reliable read before scaling.

    “AppLovin supports geo holdout tests and third-party MMP integrations for incrementality measurement.”

    Read it on commonthreadco.com

  • GoogleSep 9, 2026Caveat

    Google claims its Meridian GeoX geo test design cuts the budget needed by more than 31% for large advertisers, with no sample or method given. Its minimum test budget fell to $5,000 in November 2025.

    “budget savings of more than 31% for large advertisers”

    Read it on ppc.land

  • GoogleSep 3, 2026Supports

    Google's GeoX setup needs daily pre-test history by geo of at least three times the test length, and a year or more where seasonality is strong.

    “you'll provide a minimum of 3*N days worth of response data, such as revenue or conversion counts, where N is equals to the duration of the actual test period of your experiment”

    Read it on developers.google.com

  • GoogleSep 1, 2026Supports

    Google's GeoX guide calls for at least 10 geos for a single-cell test, ideally 50 to 100+, daily data only, and says geo tests usually cost more and run longer than user-based lift tests.

    “You should include a minimum of 10 geos for a single-cell design”

    Read it on developers.google.com

  • Taylor Sicard ConsultingSep 1, 2026Supports

    Taylor Sicard says statistical power, more than test length, limits a geo test. Estimate holdout orders first, since a handful of orders a day in the control region cannot show a realistic lift.

    “A brand doing a handful of orders a day in the control region is buying an expensive shrug”

    Read it on taylorsicard.com

  • SellforteAug 27, 2026Supports

    Sellforte says geo tests often need 30% to 50% of eligible regions held out, and screens tests by wanting expected lift at least twice the detectable lift. Its examples are hypothetical.

    “In many practical designs, holding out roughly 30% to 50% of eligible geographies creates a stronger comparison.”

    Read it on sellforte.com

  • Silverback StrategiesAug 27, 2026Caveat

    Silverback Strategies says lead gen brands should fund search to saturation first, then spend the next dollar on demand creation proven with lift tests of four to eight weeks, which small sellers often cannot run.

    “Once demand capture is saturated, additional budget there produces diminishing returns, and the next dollar is better spent creating demand.”

    Read it on silverbackstrategies.com

  • RecastAug 24, 2026Caveat

    Recast, which sells geo testing, advises geo tests of no less than two weeks, with a month as a good start, and says that for a fixed spend a shorter test is more powerful.

    “Counterintuitively, for a fixed amount of spend, a shorter test will be more powerful than a long one”

    Read it on geolift-docs.getrecast.com

  • MeasuredAug 21, 2026Caveat

    Measured says that in one four-week geo holdout of a retailer's streaming TV, roughly half the conversions the platform claimed were incremental. It says TV tests typically run four to eight weeks.

    “most streaming platforms support geographic targeting exclusions, so the holdout can be implemented directly in the buying platform.”

    Read it on measured.com

  • WorkMagicAug 12, 2026Supports

    WorkMagic, a testing vendor, defaults geo tests at 80% power and 95% confidence, a typical 21-day test plus a 7-day cooldown set by purchase cycle, and daily budget as cost per order times expected daily orders.

    “Standard practice aims for ≥80% power, meaning at least an 80% chance of identifying true lift”

    Read it on help.workmagic.io

  • DarkroomAug 7, 2026Supports

    Darkroom, an agency, designs geo tests to detect a 5% lift with 12 to 15 markets per side, sized on your own history, and says too few markets can't be fixed by running longer. No results given.

    “eight markets selected by media availability can't be fixed with a longer runtime”

    Read it on darkroomagency.com

  • MeasuredJul 30, 2026Supports

    Measured, which sells geo testing, says incrementality tests commonly run four to eight weeks and almost never under four, since ending early misses lagged sales. Its illustrative Meta example needs about six weeks.

    “almost no test should run under four weeks regardless of what the power math allows”

    Read it on measured.com

  • MeasuredJul 30, 2026Supports

    Measured, which sells geo testing, says set the target lift from break-even economics. Detecting a 10% lift takes about 3 to 4 weeks at 20,000 weekly conversions, 12 or more at 1,000.

    “Set your target lift from economics (typically breakeven lift, not the lift you hope for)”

    Read it on measured.com

  • RidgeJul 28, 2026Supports

    Ridge says a four-week TikTok GMV Max geo-lift study on one product line found 88% of the lift came outside TikTok Shop: 49% on Amazon and 39% on its own site.

    “88% of lift from our GMV max ads was coming outside of TikTok”

    Read it on podcasters.spotify.com

  • AppLovinJun 16, 2026Caveat

    AppLovin says brands' holdout-measured iROAS relative to its click-only reported ROAS has more than doubled in a year, giving no test count. Its own holdouts cover 20 to 50% of geos at 90% power.

    “MER, total revenue divided by total marketing spend, is the simplest of all of them”

    Read it on applovin.com

  • EightxJun 1, 2026Supports

    Eightx says geo holdouts should run 4 to 8 weeks, ideally 6, since 2-week tests usually fail, and are generally not worth it under $5M revenue. It shows no test data of its own.

    “Most first tests fail because the window is too short to clear noise.”

    Read it on eightx.co

  • ElevarusMay 30, 2026Supports

    Sets a lower floor than Sellforte's 30% to 50%: Elevarus says a holdout under 15% of regions is useless, and below $40K a month on a channel, use platform lift tests or skip testing.

    “A 5% holdout on a national account produces a control group too small to compare against anything.”

    Read it on elevarus.com

  • AmsiveMay 27, 2026Supports

    In a real client's YouTube geo test design (about $12.4K a month, 17 weeks), 4 control cities could detect a 21.5% lift and 10 cities 15.0%, so a true 10% lift would be missed.

    “If your team would reallocate budget at a +10% lift but not at a +5% lift, the test needs to distinguish those two outcomes.”

    Read it on amsive.com

  • StellaMay 26, 2026Supports

    Across 225 geo tests on its platform, Stella, which sells testing, found a median 2.31x incremental ROAS. It suggests 4 to 6 weeks for most brands and skipping tests that can't get a few hundred conversions.

    “The confidence interval matters more than the point estimate”

    Read it on stellaheystella.com

  • ElevarusMay 7, 2026Caveat

    Elevarus says most accounts need 18 months of weekly spend and revenue for a mix model, single-channel advertisers don't need one, and a small geo test should come first. No data.

    “Single-channel advertisers do not need this. Multi-channel advertisers do.”

    Read it on elevarus.com

  • HausMar 10, 2026Supports

    Haus, which sells incrementality tests, says branded search tests need 2 to 3 weeks, Meta conversion tests 3 to 4, and YouTube about 5 to 6 with a post-campaign window, which raised measured iROAS 79% on average.

    “If you stop measuring the day your campaign ends, you are throwing away data.”

    Read it on haus.io

  • AppLovin2026Supports

    In AppLovin's case study, Ridge ran a three-week Haus geo holdout of 20% of US regions. Amazon revenue rose 14.61%, an incremental ROAS of $1.24 against a $0.80 target, and Ridge then nearly quadrupled spend.

    “The lift was visible across both sales channels, with Amazon driving the majority of incremental value.”

    Read it on applovin.com

In the full answer

For readers who sign in
  • What to do this week3 steps
  • The numbers behind it3 figures from cited sources
  • Where each source standsA chart placing each source on the question
  • The strongest disagreementThe best case against the answer, from a cited source
  • How sure we areWhat its confidence rests on, and what would change the answer

Read next

More in Incrementality tests