How far should we trust connected TV vendors' reported results, such as verified visits and view-through conversions?
Our answer
Rank creatives, audiences and placements on a connected TV platform's verified visits and view-through conversions. Fund the channel from a geo holdout on your own orders.
- Confidence
- Medium
- Strongest proof
- 4 official rules
- 6 datasets, 3 practitioners, 4 opinions or claims
- Sources
- 10 sources
- 17 statements
M
TPAV
New here? Take the 1-minute tour
Why this is the answer
3 reasons and our judgmentPlatforms over-credit themselves even when the channel works. In Measured's four-week geo holdout of a retailer's streaming TV, about 52% of the conversions the platform reported were incremental. The channel still returned $2.46 per dollar.
Each platform sets its own counting rules. MNTN counts a Verified Visit for 7 days after a fully viewed ad on retargeting and 14 on prospecting, adjustable up to 180 days on MNTN Select. Roku counts view-through conversions for 14 days, including modeled ones.
Vendor dashboards can be wrong in either direction. Tatari (TV ad buyer) found shared IP addresses carried 57% of one client's view-through responses on 28% of impressions. In a case InterMedia Advertising described, a match to customer records found 1,250 checkouts against a pixel's 109.
Our judgment
Ranking with vendor numbers and budgeting from your own holdout is our call. Vendor numbers rank creatives, audiences and placements inside a platform, and a geo holdout on your own orders sets the budget. That follows Tatari's rule to optimize on view-through and justify on incrementality, and Cody Plofker's view that no one should grade their own homework. Expect the dashboard to be wrong in either direction rather than applying a fixed discount, since Measured's holdout and the InterMedia case point opposite ways. Before relying on a number, ask the vendor for its window, view rule, paid search handling, modeled share and who ran any holdout.
Our judgment, built from Tatari, Measured, Cody Plofker, AdExchanger, Prescient AI, MNTN, Roku and Vibe: our reading of these sources, not a finding from any one of them.
What the sources say
17 statements from 10 sourcesMNTN lets advertisers set a visit window of up to 180 days plus a conversion window. It says changing a window changes which events get credit, not how many visits or conversions happened.
“Adjusting an attribution window changes which events receive attribution credit, not the actual number of visits or conversions generated.”
An agency executive says that for one DTC advertiser a DSP pixel logged 109 checkouts while matching impression IPs to CRM logs found 1,250, and urges holdouts and MMM over claims of exact CTV tracking.
“Holdouts can tell us whether the media caused something to happen. MMM can capture effects that user-level attribution misses.”
Measured's CTV panel, over $25M of spend, found streaming about 75% more incremental than linear TV and YouTube CTV and video at 1.6x the category benchmark. Small-budget CTV tests often showed no measurable lift.
“the platform is rarely the variable that decides the outcome”
Measured, which sells incrementality testing, says CTV platforms' own attribution consistently over-credited itself in its panel, and that MNTN's Verified Visits should be read as directional, not causal.
“Verified Visits is a correlational attribution model, so it will over-credit versus incrementality testing.”
Jetfuel, an agency, says Meta stays more efficient and CTV earns a test once social and search stop scaling. A clean 60 to 90 day test usually needs a five-figure budget, read with a holdout or geo test.
“Meta stays the more efficient direct-response channel. CTV earns a test once social and search stop scaling.”
Vibe, a CTV ad seller that competes with MNTN, says incrementality the platform runs and reports itself differs from tests verified in your own tool, and lists questions to ask sellers about holdouts and windows.
“A fixed platform attribution window reflects the platform's choice, not your measurement.”
Measured, which sells geo testing, says a four-week streaming TV geo holdout found only about 52% of platform-reported conversions were incremental, and that seller-run lift studies and panel attribution can mislead.
“the platform controls the test design, the holdout construction, and the reporting, which creates an obvious incentive conflict”
Measured says that in one four-week geo holdout of a retailer's streaming TV, roughly half the conversions the platform claimed were incremental. It says TV tests typically run four to eight weeks.
“most streaming platforms support geographic targeting exclusions, so the holdout can be implemented directly in the buying platform.”
Cody Plofker's first independent check on TV is the post-purchase survey, scaled up by the response rate (if half of buyers answer, double it), then compared with other attribution models.
“never allow anyone to create their own homework”
PPC Land says a Lifesight report made with four CTV sellers claims a 22.3% paid search lift from CTV but gives no sample, period or method; one test's 3.03x return came mostly from existing customers.
“None discloses methodology, control design, or measurement window.”
Pushes back on geo tests: Prescient AI says they suffer contamination between markets and show only one window, and that its own mix model shows Tatari TV campaigns reporting $13 where it credits $28,053.
“None of these methods works best in isolation. The strongest approach uses one to check the other.”
PPC Land reports a study by identity sellers Adstra and InterMedia: only 23% of residential IP addresses reached their intended geographic target, and device IDs were 71% consistent month to month versus 57% for IPs.
“found that just 23 percent of residential IP addresses reached their intended geographic target”
Tatari says TV attribution that does not subtract normal baseline traffic overcredits TV. In one client case, shared IP addresses got 28% of impressions but 57% of 1-day view-through responses.
“Use view-through to optimize; use incrementality to justify.”
MNTN, which sells CTV ads, counts a Verified Visit when a household watched the full commercial and visits within 7 days for retargeting or 14 for prospecting. Its identity graph spans 132 million households.
“Your TV ad must have been viewed to completion”
MNTN's incrementality reporting, for prospecting campaigns with its pixel, holds back ads from 10% of the targeted audience and subtracts that group's scaled results from the exposed group's.
“MNTN automatically holds back ads from 10% of your targeted audience to form a control group.”
MNTN says its Verified Visits drop privacy-masked traffic and skip UTM-tagged visits, which it says underreports, but it is moving its own reporting to first touch, crediting visits that show a Google ad click.
“MNTN is moving to a First-Touch model when it comes to our platform's own reporting”
Roku credits view-through conversions for 14 days and includes modeled conversions, so its counts can exceed your measurement partner's, which it calls common to all self-attributing networks.
“This pattern is common across all self‑attributing networks, not just Roku.”
In the full answer
For readers who sign in- What to do this week3 steps
- The numbers behind it3 figures from cited sources
- Where each source standsA chart placing each source on the question
- The strongest disagreementThe best case against the answer, from a cited source
- How sure we areWhat its confidence rests on, and what would change the answer
Read next
More in Connected TV- What creative works on connected TV: length, format and the first seconds?
- Can we reuse our Meta and TikTok videos on connected TV, or do we need spots made for TV?
- Should we advertise in Prime Video and Amazon's other streaming TV inventory, and how?
- Should we advertise on Roku, and which of its ad products fit us?