Change Regression Detector

Automatically links performance drops to the page changes that caused them

  1. agent ›Regression on the checkout's delivery step: conversion fell from 61% to 52% in the 48 hours after yesterday's change.
  2. agent ›Evidence: the delivery options were reordered, and 'Pick-up point' is no longer pre-selected.
  3. you ›We changed four things on that page yesterday. Why blame the delivery order?
  4. agent ›The other three are copy edits below the options, and clicks on them didn't move. Clicks on the delivery selector rose 34% — people are hunting for the option they used to get by default.
  5. you ›Our carrier wants home delivery listed first. Can't we keep it?
  6. agent ›Keep it first, but pre-select pick-up point again — that's the part that converted. Leaving it as it is costs about DKK 9,800 a day at today's traffic.

What it does

Runs after every crawl. For each page where Historian found a direct content change, it compares the 24–48 hours after the change with the period before it: click rates on the page's elements, conversion rate and revenue. It looks at the pages that changed, not the whole site, so a regression on one checkout step is not drowned out by a good day elsewhere. When the numbers drop, the insight carries the evidence: the page, the element that changed, the kind of change (copy, image, order, removed or added), and the before-and-after figures — enough to decide whether to roll back without opening a dashboard.

Category
Action & Recommendation
Data sources
AI descriptions of what changed · Recent page changes · Change impact analysis · Page analytics
Schedule
Daily, after each crawl

An example insight.

What a result from Change Regression Detector looks like. The numbers are an illustration, not a customer's.

Change Regression Detector · Regression · Example

Last deploy made the mobile checkout CTA hard to see

The latest deploy changed the primary button on the mobile checkout page from dark green to light grey. Its click rate dropped 22% in the 48 hours after the change; the rest of the page held steady.

DKK 13,000

Stop guessing why revenue dropped.

Book a demo and we'll show you what Historian finds on your own store.