On this page
concept

Incrementality

Created 2026-06-27 24 connections

Incrementality

Incrementality measures whether a marketing campaign caused outcomes (sales, conversions, new customers) that would not have happened without the ad exposure — the true causal lift, isolated by comparing an exposed group against an unexposed control. Per eMarketer, this is the key distinction from attribution, which only assigns credit across touchpoints and proves correlation, not causation. Incrementality is the contested measurement core carried forward from run 103's Retail Media page, and it sits alongside Media Mix Modeling (MMM) and Promotional Uplift Modelling in the vault's measurement cluster. This page records what sources report; it does not advise.

Firewall: every claim below is what a named source reports. See ../../CONTEXT.md Rule 1. This was a web-only run — the Reddit and YouTube practitioner streams were both unavailable (reddit-research MCP not connected, tool_uses: 0; Apify YouTube transcript actor not connected, 7 candidate videos logged but none transcribed). The page therefore carries no practitioner counter-narrative and leans on analyst (eMarketer/TransUnion, ANA) and vendor sources (Skai, MHI, Remerge, Measured, Haus). Vendor claims are flagged inline.

Why it matters in ecommerce

Per eMarketer, three forces are driving adoption: privacy-driven tracking loss (cookie/IDFA decline making user-level attribution unreliable), Retail Media accountability pressure, and budget scrutiny. For an ecommerce product or performance team, incrementality reframes the core question from "which channel gets credit?" to "would this purchase have happened anyway?" — a direct challenge to last-click attribution and headline ROAS.

Attribution vs incrementality

Per eMarketer, attribution assigns credit across touchpoints but cannot prove causation; per the MHI Growth Engine (vendor), last-click can credit a paid ad for a sale a customer would have made regardless — e.g. a loyal customer clicking a retargeting ad before a planned repurchase, where "would they have bought anyway? Almost certainly yes." Incrementality isolates the lift the ad actually generated.

The triangulation framing (MMM vs MTA vs incrementality)

Per eMarketer, the three methods answer different questions and the strongest programs use all three:

MethodQuestion it answersLimitation (per eMarketer)
MTA (multi-touch attribution)"Which channels contributed?"Tracks journeys to assign credit; cannot prove causation
Media Mix Modeling (MMM)"How does the whole mix perform?"Models aggregate inputs; now on 1–3 month cycles (per MiQ)
Incrementality"Did this campaign cause net-new outcomes?"Experiment-based; costs short-term revenue to run

[!unverified] Per the Measured FAQ (vendor — body exceeded fetch limit, definitional framing confirmed via search snippet only): MMM is strategic/mid-to-long-term, MTA is tactical/short-term, and incrementality is the causal-validation layer.

In a July 2025 eMarketer/TransUnion survey, 27.6% of US marketers rated MMM the most reliable methodology, MTA 19.4%, and unified measurement 18.9% (as-of 2026-04-03).

How it is measured

Per eMarketer, the core design splits the audience or market into a treatment group (exposed) and a control / holdout group (not exposed); the difference in outcomes is the incremental lift. Common approaches: randomized holdout tests, geo-based experiments, and synthetic control groups.

  • Geo experiments designate geographic regions as test vs control markets and suit channels where user-level holdouts are impractical (TV, OOH, Retail Media); per eMarketer, Haus geo experiments on TikTok averaged ~21 days to detect lift (as-of 2026-04-03).
  • Continuous, not one-time. Per Remerge (vendor, 2019), incrementality is best run continuously, and long-running tests require "reshuffling" group assignment so no cohort is permanently ad-deprived.

Method taxonomy

The canonical method taxonomy below is from Remerge "Incrementality Tests 101" (2019-09-23, vendor). Included because it remains the canonical framing cited by 2026 sources; methodology fundamentals, not volatile benchmarks.

MethodHow control is treatedTrade-off (per Remerge)
Intent-to-Treat / holdoutControl sees no adsFree and easy but "noisy" — unexposed users in the test group dilute the signal
PSA / placeboControl served public-service adsIdentifies who would have been exposed (zero noise) but costs ad budget and risks apples-to-oranges optimization bias
Ghost Ads (Garrett Johnson, 2017)Control served another advertiser's ad, flagged with a "ghost impression"PSA-level precision at no cost, but works poorly for retargeting (needs a second interested bidder)

Per Remerge citing Think with Google, Google itself cautions that PSA control groups can produce "apples-to-oranges" comparisons that are "overly optimistic or falsely negative" because different ads get optimized to different user types.

How much "attributed" spend is actually incremental

[!unverified] These percentages are vendor estimates with no underlying dataset cited — treat as directional, not measured benchmarks.

Per the MHI Growth Engine (vendor, 2026-02-17), across DTC brands incremental ROAS is typically 40–70% lower than reported ROAS for retargeting campaigns, while for prospecting it runs closer to reported (~70–90% of reported ROAS is incremental) (as-of 2026-02-17). MHI's worked example: a retargeting campaign reporting 6x ROAS where a holdout shows 60% of conversions would have happened anyway yields an incremental ROAS of just 2.4x.

Per eMarketer, incremental ROAS numbers run lower than traditional ROAS because incrementality sets a higher measurement bar; marketers used to last-touch figures must reset expectations (per Kroger Precision Marketing). Conversely, per eMarketer, Haus geo experiments on TikTok found an additional 68% lift in the primary KPI during the post-treatment window — i.e. some campaigns build demand gradually and standard attribution misses delayed effects (as-of 2026-04-03).

Adoption, cost & barriers

Per the July 2025 eMarketer/TransUnion survey (as-of 2026-04-03):

  • 52% of US brand and agency marketers use incrementality testing; 36.2% plan to increase incrementality spend over the next 12 months.

Per Search Engine Land (via eMarketer), Google lowered the minimum budget for incrementality experiments from ~$100,000 to ~$5,000 by adopting Bayesian statistical models (as-of 2026-04-03).

Per Skai / Path to Purchase Institute (vendor, via eMarketer), adoption outpaces maturity: 44% question the reliability of incrementality results (top barrier), 43% struggle to apply it across ad types/retailers, 41% cite insufficient tooling, and 33% of CPG marketers measure incrementality only "at a basic level" (as-of 2026-04-03).

Per eMarketer, recommended test execution is to run for at least 3–4 weeks with properly sized holdout groups, start with the highest-spend channel, and budget for the short-term revenue trade-off of withholding ads.

Retail media incrementality

Per the ANA (via eMarketer), 71% of advertisers rank incrementality as their most important Retail Media KPI; the central question is whether retail media spend drives net-new purchases or merely captures demand that already existed (as-of 2026-04-03).

Per Skai/Stratably's survey of 166 retail media advertisers (vendor, 2026-02-04), incrementality is the #1 measurement challenge (75%), ahead of cross-channel measurement (59%); only 15% say they are very/extremely effective at measuring retail media, half measure incrementality at only a basic level, and just 20% are good at both measuring and applying it (as-of 2026-02-04).

Per Skai (vendor, self-serving — Skai sells the cross-channel layer), the real blocker is not methodology or data access (methodology complexity registered at 6%, lack of retailer/platform data access at 0% among non-adopters) but capability, ownership and a shared cross-channel measurement language — 56% cited limited internal analytics/data-science resources; Megan Conahan (Direct Agents) is quoted: "Lack of analytics access is the excuse; lack of ownership is the problem."

Per Skai (vendor), industry voices say ROAS is being dethroned — "The overreliance on ROAS as the benchmark of value is over" (Jason Wescott, WPP Media); "Incrementality is now the price of performance… If you cannot measure incrementality with discipline, you are not running performance media. You are buying exposure" (Enrico Babucci, OmniShopper).

Retail media case studies (vendor/network-reported)

  • Per eMarketer, Albertsons Media Collective launched an in-store incrementality framework in early 2026; a Mondelēz test campaign delivered $2.41 matched-market incremental ROAS and a 14% lift in in-store sales across 116 locations (as-of 2026-04-03).
  • Per eMarketer, Kroger Precision Marketing runs randomized holdout tests using loyalty data covering ~95% of transactions, delivering results in under two weeks (as-of 2026-04-03).

Contradictions

What actually blocks incrementality. Skai says the barrier is not data access or methodology but capability/ownership (data access 0%, methodology 6% among non-adopters) [skai.io, 2026-02-04]. eMarketer's synthesis of Skai/P2PI data lists accuracy concerns (44%), application complexity (43%) and limited tools (41%) as top barriers — i.e. tooling and methodology do register heavily [emarketer.com, 2026-04-03]. Likely reconciled by different question framings (barriers-to-starting vs barriers-among-current-testers), but recorded unresolved.

Incremental share of retargeting. MHI states 40–70% of retargeting reported ROAS is non-incremental [mhigrowthengine.com, 2026-02-17]; no independent dataset corroborates the exact band. Recorded as a vendor estimate, not a measured benchmark.

Key terms

TermMeaning (per sources)
Incremental liftOutcome difference between exposed treatment group and unexposed control
Incremental ROAS (iROAS)ROAS counting only conversions the ad actually caused
Holdout / Intent-to-TreatControl group shown no ads; free but noisy (Remerge)
PSA testControl shown public-service ads to identify would-be-exposed users (Remerge)
Ghost AdsControl flagged via "ghost impression"; PSA precision at no cost (Johnson 2017, via Remerge)
Geo experimentTest vs control by geography; suits TV/OOH/retail media (eMarketer)

Gaps

  • No independent/peer-reviewed benchmark on incremental-vs-attributed %. All specific figures trace to agencies/platforms (MHI, Skai, Haus), not independent research. The canonical academic studies (eBay paid-search, Gordon et al. Facebook lift-vs-observational) were not fetched.
  • Branded vs non-branded paid-search incrementality (a major historical debate — branded search often near-zero incremental) surfaced in queries but no concrete figure was fetched.
  • MMM-specific critiques (Recast, Haus, Northbeam contrarian takes) surfaced but were not individually fetched; Measured FAQ retrieved but body exceeded fetch limit.
  • EU/UK-specific retail media incrementality data (relevant to the UNIQLO Europe context) was not found — all benchmarks are US-centric.
  • Both practitioner streams down (Reddit + YouTube) — no counter-narrative on whether incrementality testing is worth the revenue trade-off, or skepticism about vendor lift claims.
Research agent · 2026-06-27