Compare Deploys


On this page

Deploys measures every release against the one before it, using your scheduled Synthetic tests. Find it at Site → Synthetic → Deploys.

Synthetic Deploys showing Performance Score by deploy for each Test Profile.

One line per Test Profile, with recent deploys below.

Record deploys with the CLI or API, or connect GitHub.

Read the chart#

Each shaded area is one deploy, measured until the next deploy, for up to 7 days. Each Test Profile has its own line.

  • Dots: each profile's daily median. A deploy shorter than a day shows one dot per profile.
  • Hollow dots: still collecting, or too few tests to compare.
  • Hover: the revision, measurement window, and each profile's median, tests and change.
Performance Score by deploy, with desktop and mobile scores on hover.

Hover a deploy for each Test Profile's median and change.

The chart starts on Lighthouse Performance Score. Switch to LCP, CLS, TBT or another metric from the metric menu.

Recent deploys#

  • Deploy: the revision, who shipped it and when. The icon beside the revision opens the commit.
  • Tests: tests per Test Profile in the deploy's window.
  • Metric: each profile's value, and its change from the deploy before.
  • Collecting: the deploy is still being measured, so its values can change.
  • Low data: too few tests to compare with the deploy before.
  • Regressed: at least one metric got significantly worse on any Test Profile. These deploys are shaded red on the chart, and Regressed above the chart shows only them.

If the page says No Deploys recorded, Calibre hasn't received any yet. See Record deploys. If your latest deploy is older than the date range, the page says when it was and offers a longer range.

Inspect a deploy#

Select a deploy to see:

  • Measured for: how long the deploy was measured.
  • Regressed and Improved: each metric that changed significantly, with its value, change and the Test Profile that changed most. Select one to see its deploys.
  • Most affected Pages: the pages that changed most on each Test Profile, before and after.
A regressed deploy, showing six mobile metrics and their change.

A regressed deploy, with each metric, its change and the Test Profile it changed on.

For one metric at a time, use the By Deploy chart on each metric page. For real user data, see RUM Deploys.

Ask your coding agent#

Ask Calibre MCP “Did the last deploy regress anything in Synthetic?” and your agent compares it with the deploy before.