Value Packs / Retail / Conversion & Checkout Funnel Radar / Brief

Checkout on the mobile app broke overnight, and only the last step moved

Every surface · today · daily, live · Conversion Rate against the band each surface is expected to holdConversion & Checkout Funnel Radar · Brief 01
The single finding

Conversion on the mobile app through paid search came in at today. That is the furthest any surface sits below its own floor, on the largest session count on the page. Desktop on email is at and mobile web on paid social at . Two surfaces are above their floors: desktop on organic at and the same mobile app on direct traffic at . Underneath it, checkout completion on the app fell to . It held inside its range every day for nineteen days before it, closed the night before last, and is lower again today than it was yesterday.

So what? Something changed overnight and is still deciding the outcome of every session that reaches the last step. The traffic is arriving and the intent is intact, so each hour this runs turns paid-for demand into nothing. A checkout that fails quietly produces no complaint, only a shopper who goes elsewhere.

At a glance
Checkout Rate · mobile app61.0%

61.0 vs 68.1%

and lower again today

Conversion Rate · mobile app on paid search1.92%

1.92 vs 2.71% floor

furthest below its own band

Add-to-Bag Rate · mobile app8.8%

8.8 vs 8.9%

the first step is fine

Checkout Rate · reaching checkout45.9%

45.9 vs 46.2%

the second step is fine

Conversion Rate · mobile app2.46%

2.46 vs 2.80%

same traffic, an eighth fewer orders

Conversion Rate · mobile app on direct3.24%

3.24 vs 2.90% floor

the same app, above its floor

Every surface against the band it is expected to hold

Conversion Rate today against the band each surface is expected to hold

Three surfaces below their own floor, two above.

Mobile app · paid searchagainst its own 2.71% floor · 192K sessions
1.92%
Mobile web · paid socialagainst its own 2.32% floor · 127K
2.05%
Desktop · emailagainst its own 4.10% floor · 30K
3.76%
Mobile app · directagainst its own 2.90% floor · 157K
3.24%
Desktop · organicagainst its own 3.25% floor · 91K
3.46%

The scale runs from 0 to 5.

Mobile app on paid search came in at , the furthest below its own floor and on the largest session count. Desktop on email is at and mobile web on paid social at . Desktop on organic at and mobile app on direct at are both above theirs. Each floor is that surface's own, built from the same weekday in the three weeks before.

Checkout Rate on the app, day by day

Checkout Rate by day · mobile app

Nineteen ordinary days, then two below the range.

58%61%64%67%70%73%
1 May510152021
Checkout Rate · mobile appthe range expected of the same weekday

Checkout completion on the app held inside its range every day for nineteen days before it. It closed the night before last, and today it is — so it is lower again today than it was yesterday. The largest move any ordinary day made across those nineteen days was under two points.

Which step of the checkout actually moved

Each step of the checkout, today against a usual day

Two steps barely move. The third does all of it.

StepA usual dayTodayChangeShare of the loss
Sessions to bag8.9%8.8%−0.1 ppno change
Bag to checkout46.2%45.9%−0.3 ppno change
Checkout to order68.1%61.0%−7.1 ppthe whole of it
The three together2.80%2.46%−0.34 ppan eighth of the orders

Sessions to bag came in at and bag to checkout at , both unchanged. Checkout to order fell to . Multiplied together the app converted of its sessions. Traffic arrived above a usual day rather than below one, so more people reached the last step today than usually do, and fewer got through it.

What it costs while it runs
Conversion Rate · mobile app2.46%

2.46 vs 2.80%

on traffic that arrived in full

Checkout Rate · mobile app61.0%

61.0 vs 68.1%

and it has not recovered

Conversion Rate · mobile app on paid search1.92%

1.92 vs 2.71% floor

where the traffic was bought

The app converted of its sessions today against a usual day, on traffic that arrived above a usual day rather than below one. Paid search is the worst-hit surface at , and that traffic was bought in advance. What none of these three books can say is what changed overnight: they carry the rate at each step, not what happens inside one.

The three insights that matter most
1

One step, and only one

Sessions to bag came in at and bag to checkout at , both unchanged, while checkout to order fell to .

Why it matters: Two steps holding and one collapsing puts the fault at the end of the funnel, which is a different team and a different fix from a demand problem.

61.0%Checkout Ratemobile app, against a usual 68.1%
2

It happened overnight and has not stopped

Checkout completion held inside its range every day for nineteen days before it, closed the night before last, and is lower again today than it was yesterday.

Why it matters: A single bad day recovers on its own. Two days, the second worse than the first, is something that is still running.

8.8%Add-to-Bag Ratemobile app, against a usual 8.9%
3

The demand arrived in full

Traffic arrived above a usual day rather than below one, and the same app on direct traffic converted at against its own floor.

Why it matters: Nothing is wrong with the traffic or with the app in general, which is what makes every lost session avoidable rather than explicable.

2.46%Conversion Ratemobile app, against a usual 2.80%
You could ask next
↑

How many orders has this cost since it started?

Sizes two days of a known rate against a known session count.

⚠

Is the last step worse in some categories than others?

A flat loss across categories points somewhere different from a concentrated one.

⊕

How is the same step doing on desktop and mobile web?

Says whether this is one device or one build.

?

Did anything else on the app change at the same hour?

The question this data cannot answer, and the one that has to be asked elsewhere.

↗

Which surfaces were above their own band today?

The control: what a normal surface looks like on the same day.