New research guide: The Confidence Economy, how AI is changing fashion commerce.

Read it →

Read it →

/

/

Holdout lift report

[ 07 ] · Holdout lift report

The number it actually moved. 

The number it actually moved. 

The number it actually moved. 

Every vendor reports influenced revenue. We report the counterfactual.

No credit card · Live in under an hour

HoldoutElara
AOV
Items / session
Conversion
Sample report · your numbers come from your own holdout

[ 01 ]

in one sentence

What is a holdout lift report?

A holdout lift report measures what Elara changed by keeping a random slice of your traffic — typically 5 to 20% — from ever seeing the stylist, then comparing both groups on the same days: conversion, average order value, items per session and revenue per visitor. The difference is incremental lift, not attributed revenue, and it ships in the dashboard with significance noted, so the number you take to your CFO is one that survives the question “compared to what?”.

Also called · incrementality test · control-group measurement · A/B holdout

[ 02 ]

the gap

Why does it matter?

01

Every vendor reports “influenced revenue”. Nobody reports the counterfactual.

02

Attribution without a control is a story.

03

Your CFO asks one question: compared to what?

[ 03 ]

how it works

How does the holdout lift report work?

  1. 01
    Choose the slice
    5–20% holdout, set in the dashboard; random assignment per session.
  2. 02
    Run it
    Both groups measured on the same days and the same traffic; nothing else changes.
  3. 03
    Read the delta
    Conversion, AOV, items per session, revenue per visitor, with confidence intervals.
  4. 04
    Decide
    Keep the holdout running, shrink it, or switch it off once you are convinced; export CSV or a shareable PDF.
SAMPLE REPORT
Conversion 4× vs holdout
AOV +25% vs holdout
Items 2.4× vs holdout
SAMPLE REPORT · YOUR NUMBERS
COME FROM YOUR OWN HOLDOUT
Same days, same traffic. The delta is the lift.

[ 04 ]

the numbers

What does it do to the numbers?

+0%
Average order value
0×
Conversion, assisted sessions
5–20%
Holdout share
Industry standards for AI-assisted shopping sessions. Your holdout report shows your own.

Online fashion conversion rates typically sit in the 1–3% range, according to the industry benchmarks in our stats post — the baseline most fashion stores start from. Against a baseline that low, small changes look large and attributed figures look larger. A holdout keeps the comparison honest: the same days, the same traffic, one group without Elara — so whatever moves is the stylist’s doing, and nothing else.

[ 05 ]

versus

How is it different from “influenced revenue” dashboards and last-click attribution?

ElaraInfluenced revenueLast-click attribution
Control group that never sees the tool
Measures conversion, AOV and items, not clicks
Significance shown
Same days, same traffic
Exportable for finance

[ 07 ]

who it is for

Who is it for?

Heads of Ecommerce who have to defend a line item, and finance teams who have stopped believing “influenced revenue”.

RANDOM PER SESSION

CSV · PDF

ON EVERY PLAN

[ ? ]

questions

Questions a Head of Ecommerce asks first. 

Questions a Head of Ecommerce asks first. 

Questions a Head of Ecommerce asks first. 

Anything else, book twenty minutes and ask the founder directly.

Yes, once you are convinced — and back on at any time. Most brands keep a small holdout running so every month’s number stays measured rather than assumed.

Sessions are assigned at random, both groups run on the same days and the same traffic, and the report shows confidence on every delta. It is the same method as an A/B test, with Elara as the only variable.

Conversion rate, average order value, items per session and revenue per visitor for the Elara group versus the holdout, plus engagement with the stylist for the Elara group.

10% is the default. Smaller stores can run 20% to reach significance sooner; larger stores can run 5% and lose almost nothing.

Yes. CSV for your own analysis and a shareable PDF for finance, both from the dashboard.

Yes. The holdout lift report is on Starter and above, because a stylist that cannot prove its number should not be paid for.

Give your store a stylist that actually sells. 

Give your store a stylist that actually sells. 

Give your store a stylist that actually sells. 

Thirty days free. Live in under an hour. Measured against a holdout from day one.

Slide to start your trial

No credit card · Cancel any time