Changelog

New features, improvements and upcoming releases in Calibre. Subscribe to updates:

Core Web Vitals Test, now with ad metrics

New featureFree toolsMetrics

Today, Google announced four experimental ad metrics in the Chrome User Experience Report (CrUX). They’re now in our free Core Web Vitals Test, in a new Advertising section.

Here’s a live report for independent.co.uk to dig into while you read.

The Advertising section of the Core Web Vitals Test report for independent.co.uk, showing Total CPU usage by ads at 7.25 seconds and Total network usage by ads at 5.10 MB, each with a bar chart of the 75th percentile over the last three months.

Total CPU usage and Total network usage by ads for independent.co.uk: the 75th percentile value, with a trend over the last three months.

The four metrics are:

  • Viewport ad density: the share of the viewport covered by ads.
  • Viewport ad count: the number of ads visible in the viewport.
  • Total CPU usage by ads: processor time used by ad frames.
  • Total network usage by ads: data downloaded by ad frames and ad resources.

To be eligible for ad metrics data in CrUX, a site needs an ads.txt file with at least one authorised seller. If there’s no ad metrics data for a site, the Advertising section simply isn’t shown.

Read the ad metrics documentation for the full detail.

See the performance impact of every website deployment

New feature

Today we are bringing Deployments to Real User Monitoring (RUM), making it easier compare performance before and after a release.

In RUM, you’ll see deployments running across the bottom of charts. Deployment flags display on hover and include commit details. You can click through to see the commit in your source control system.

Hovering over a deployment marker on a real user monitoring chart. A flag shows the deploy commit, time and author, alongside the metric tooltip for that day.

Hovering a deployment marker reveals the commit, time and author, alongside that day’s metric.

Each metric page now includes a segmented view, so you can see how recent deploys compare, with full context of how much data is being assessed.

Metric: Largest Contentful Paint by Deployment. Each deployment is compared to the previous one, and the number of samples is shown for each.

Metric: Largest Contentful Paint by Deployment. Each deployment is compared to the previous one.

Viewing more detail allows you to see recent deployments over time, and compare longer-term changes.

LCP by Deployment, showing where each deployment started and ended.

LCP by Deployment, showing where each deployment started and ended.

Getting started with Deployments#

Deployments are available on all plans, and any deploys you’ve already sent to Calibre will appear on your charts already.

You can notify Calibre when you deploy your website using webhooks, the Calibre CLI, or the Node.js API.

Or, alternatively, connect your GitHub account from Site → Settings → Integrations, and Calibre will watch GitHub for production deploys, using the Deployment Branches setting to work out which deployments count as production.

Synthetic Metrics: All pages, segmented by Test Profile and Deployment

New featureMetrics

Synthetic Pulse and Metrics have been revamped to display median aggregated metrics, combined for all pages.

Previously, you would view Synthetic metrics for a single page at a time. Now you can view all pages at once, or filter by a single page, as before.

The rebuilt Synthetic metric page for Largest Contentful Paint set to All pages. There are panels for LCP by Test Profile, and segmented by Deployment.

Metric: Largest Contentful Paint for All pages.

Each metric page includes a segment views for:

  • By Test Profile: how each device profile differs.
  • By Deployment: how deployment changed the metric.
  • By Page: whether a change is site-wide or isolated.

Navigate to Synthetic → Pulse and click on a metric title to see the new metric pages, or go direct to Synthetic → LCP from the left-hand navigation to see the new metric page for Largest Contentful Paint.

You can freely switch between metrics, pages, and date ranges to see how your site performance is trending over time, and see how each segment contributes to performance.

Monitor Single Page App performance with soft navigations

New FeatureReal User Monitoring

Monitoring in-page UX in single-page apps (SPAs) has always been spotty. Core Web Vitals and other metrics are based around the concept of full page loads — but, SPAs load once, then swap content dynamically as users "soft" navigate. Everything after that first load has been somewhat invisible.

That changes with soft-navigation attribution, which lets browsers detect when an in-page navigation occurs — making it possible to collect accurate Core Web Vitals for each soft navigation.

Calibre RUM now measures soft navigations automatically, with no additional configuration required. Browser support is currently Chrome 151+, Edge 151+, so bare in mind that current observations will be limited, until browser support improves.

You’ll see Core Web Vitals for your SPA with accurate URL attribution, giving you a much clearer picture of real user experience across your sites and apps.

Filter any RUM report by **Soft navigation** to see how in-app route changes perform, including subparts and the elements responsible.

Filter any RUM report by Soft navigation to see how in-app route changes perform, including subparts and the elements responsible.

Filter any report to see soft navigations on their own, or view by navigation type to compare them against the initial load.

Grouping by Navigation type displays Soft Navigation performance alongside others

Grouping by Navigation type displays Soft Navigation performance alongside others. (Figures displayed are for demonstration purposes only).

If you already run Calibre RUM, there’s nothing to install or turn on: soft navigations start flowing in automatically.

To learn more, see Filtering RUM reports and the RUM documentation, or read about the evolution of soft navigations in Google Chrome’s Monitoring soft navigations explainer.

Synthetic site scan, a new way to import and monitor your site

New FeatureImprovement

Until now, managing which page URLs are monitored by Calibre’s Synthetic monitoring was a manual job. From today, Calibre can automatically crawl your site, looking for the most important pages.

You can type one URL into Calibre, and it will continuously crawl a site; finding new pages, and removing old ones, so you can monitor whole websites without having to think about constantly updating settings.

The new Synthetic site scan crawler uses signals such as internal link structure, navigation placement, and other factors to determine which pages are most important. Just like real users would when navigating your site.

Updated Site creation flow#

When you add a Site, you’ll see a new option to Discover pages automatically. Alternatively, you can continue to Add pages manually.

Manage which URLs to monitor with Discover pages automatically or Add pages manually.

Manage which URLs to monitor with Discover pages automatically or Add pages manually.

Once your Site has been created, you can watch data come in from Synthetic tests and Google’s CrUX (when available), or install RUM monitoring while you wait.

Site setup for qantas.com.au: pages discovered, Google CrUX field data found, and first Synthetic tests ready, with an option to install RUM.

Site setup complete, Synthetic tests and CrUX data ready.

If you have an existing Site, you can switch to Discover pages automatically from Synthetic → Settings → Pages. After turning on this option, Calibre will scan your Site and monitor pages automatically.

You can follow our getting started guide for a walk-through of the new setup flow, or check the pages documentation for more details.

Self-service SAML Single Sign-On, now available on the Team plan

New featureAccount and BillingSecurity

SAML Single Sign-On is now fully self-service, and available on the Team plan as well as Company.

The new Authentication panel (Organisation settings → Authentication) allows admins to configure SAML SSO and SCIM provisioning.

Domains are verified using DNS TXT records, and the connection is tested to ensure your IdP is configured correctly, avoiding account lockouts.

You can test the connection to verify your IdP is configured correctly before enforcing SAML SSO for your team.

You can test the connection to verify your IdP is configured correctly before enforcing SAML SSO for your team.

Once you’ve verified your domain and tested the connection, you can enforce SAML SSO logins for your team, and optionally enable SCIM provisioning to automatically create, update and deactivate accounts from your identity provider.

We’ve also updated our Security and Privacy pages to cover SSO sessions, enforcement and how SSO account data is provisioned.

Read the documentation for more information on how to set up SAML SSO and SCIM provisioning for your organisation.

Audit log: a complete record of security and admin activity

New featureAccount and BillingSecurity

The Audit log gives a complete, organisation-wide record of security and administrative activity: sign-ins, member and role changes, credential and API key activity, billing and SSO changes, and more. It's built for compliance, security reviews and investigations, giving you a clear audit trail of who did what, when, and from where.

The organisation-wide Audit log, listing events with the person, action, target, country and device for each one.

Every security and administrative event in your organisation, recorded with the person, action, target, country and device.

Filter by event type, time range or a single person, export a month of history at a time as NDJSON, or stream every event to your SIEM in real time with signed webhooks.

The Audit log webhook settings, showing the endpoint URL, signing secret and a recent deliveries table.

Stream every audit event to your SIEM or endpoint, signed so you can verify it came from Calibre.

You can also choose how long events are kept, and place a legal hold to preserve everything during an investigation or for compliance.

The Audit log is available now on the Company Plan. Read the documentation for setup, the event payload and signature verification.

Fix up, look sharp: Updated navigation, and a faster way to switch sites

New featureDesign

Today we’re shipping a rebuilt interface, designed around an all-new primary navigation.

After a few years of growth and new features, we wanted to consolidate how people move around the app, and make it faster to get to the data that matters.

Switching between sites without leaving the keyboard: Command-K to open the switcher, arrow keys to find a site, and Enter to navigate.

Navigation is now a single, focused left-hand sidebar. At the top is a switcher: open it from anywhere with a keyboard shortcut (Command-K, or Ctrl-K), start typing, and jump straight to any site. You’ll see a list of the most recent sites, and you can search for others quickly.

The new Sites /home brings all your sites into one comparison view. You can switch between different team workspaces to compare sites by Synthetic, CrUX or RUM.

Calibre’s new Sites home, showing the primary sidebar and a data source toggle for Synthetic, CrUX and RUM.

The new Sites home, showing the "Airline Benchmarks" team, with a data source toggle for Synthetic, CrUX and RUM.

Across Calibre, you’ll also notice a tighter, more cohesive design: more consistent typography and spacing, a clearer icon set, and a new loading skeleton built to avoid layout shift, so the app settles into place sooner.

New in CrUX: UX Rating, world maps and a new Audience report

New featureCrUXMetrics

We’ve made big improvements to CrUX monitoring, giving you a clearer view of how real users experience your site around the world. It now includes UX Rating, a brand-new Audience report, and a world map on every metric page, each adding a new level of insight.

UX Rating, now available for CrUX#

UX Rating is a single score that summarises user experience quality, based on the percentage of users who experienced good performance for Core Web Vitals and Time to First Byte.

It has been part of RUM reporting for a while, and now it’s in CrUX Monitoring too.

You’ll see UX Rating on your Sites list (to compare all your monitored Sites at a glance), on the Pages report for each Site, and on the new Audience report, which breaks it down by country.

The Calibre Sites list for the Airline Benchmarks team with the CrUX data source selected, comparing airline websites ranked by UX Rating alongside LCP, CLS and INP.

The Sites list ranks every Site you monitor by UX Rating, alongside LCP, CLS and INP, so you can benchmark against competitors at a glance.

The new CrUX Audience report#

The Audience report is the clearest view yet of where your users have a good experience, and where they don’t. You’ll see a world map of your UX Rating, ranked by country.

CrUX Audience page showing an overall UX Rating worldview of 82, an interactive hexagonal world map, and a ranked list of the best and worst-performing countries.

CrUX Audience plots your UX Rating on a world map, ranked by the best and worst-performing countries.

There’s also a breakdown by device types and navigation types, so you can gain a better understanding of how people experience your site in different contexts.

Metric pages, restructured#

CrUX metric pages have been restructured to make the data easier to understand and act on.

Across the top, you’ll see the current metric value with colour-coded grading against Google’s thresholds.

The restructured CrUX Largest Contentful Paint page, showing the metric value and grade, a trend chart, LCP subparts and element type, and a world map of performance by country.

The restructured LCP page: value and grade, trend, subparts, element type, and performance by country.

For LCP, you’ll see LCP subparts and element type: the components that make up LCP, and the element most commonly responsible for it.

Each metric page also includes a world map, so you can see how performance varies by country.

It’s all live now for every Site tracked in Calibre. To open the new worldview, navigate to Site → CrUX → Audience, or read the documentation.

Core Web Vitals Test, now with UX Rating

New featureFree toolsMetrics

Following on from Compare Website Speed last week, we’re rolling out another upgrade to our free tools: a rebuilt Core Web Vitals Test.

Here’s a live report for ikea.com to dig into while you read.

The new Core Web Vitals Test report for ikea.com showing an overall UX Rating of 92 and three Core Web Vitals (LCP 1.07s, CLS 0.01, INP 105ms) all marked Good.

Front and centre: an overall UX Rating, summarising your site’s real-user experience in a single number.

Now with UX Rating#

Up front, you’ll see UX Rating: the share of real-world experience on your site that rates as good. Every metric a real Chrome user records is graded, and UX Rating is the percentage of those grades that came back good.

It tells you how much of what your visitors experience is actually good, and gives you a faster read than scanning a wall of metrics. Read more about why we built UX Rating.

It also makes for clean comparisons: see how your UX Rating stacks up against competitors, side by side.

See performance country by country#

UX Rating is also plotted globally, rendered on our custom hexagonal world map, so you can see how user experience varies between the countries your site serves. There’s also map data for LCP, CLS, INP and even TTFB.

UX Rating by country on the Core Web Vitals Test, showing an interactive hexagonal world map alongside a ranked list of the ten best-performing countries.

Performance by country, rendered on our 10kb hexagonal world map.

Country-level CrUX data requires using Google’s BigQuery database, which is complex and eye-wateringly expensive. We’ve done it; you don’t have to. And then we made it free.

Deeper metric reports#

Dig into Largest Contentful Paint, Cumulative Layout Shift and Interaction to Next Paint with up to 9 months of history, experience distributions, and subpart breakdowns.

Spot a degrading trend in LCP, see where your users are getting stuck on INP, or confirm a recent CLS fix landed cleanly.

Largest Contentful Paint detail page for ikea.com, showing a 1.07 second LCP marked Good, a degrading trend chart, and an experience distribution by user experience.

The LCP detail page, with a trend chart flagging a degrading 75th percentile, and an experience distribution by user experience.

Powered by real Chrome user data#

The data comes from Google’s Chrome User Experience Report: the same field dataset used in Calibre’s dedicated CrUX Monitoring product.

Use Core Web Vitals Test to:

  • See whether any site passes Google’s Core Web Vitals assessment.
  • Get a UX Rating that tells you how much of your visitors’ experience is actually good.
  • Compare performance across the countries your site serves.
  • Trace regressions in LCP, CLS or INP across 9 months of history.
  • Share any report by URL, no sign-up needed.

For continuous monitoring of all your websites (and competitors), use Calibre CrUX Monitoring.

Calibre combines CrUX, Real User Monitoring and Synthetic Monitoring, giving you everything you need to monitor and improve your sites. Start a free trial.

Try Core Web Vitals Test on any site:

Check your Core Web Vitals

New tool: Compare Website Speed

New featureFree toolsMetrics

Today we’re launching a new free tool: Compare Website Speed.

Drop in up to 5 sites and get a ranked leaderboard built from real Chrome user data, sourced from the Chrome User Experience Report. Every comparison gets a permalink and an auto-generated share card that names the winner.

Share card ranking US retailers by Core Web Vitals: ikea.com 1st (92.1), amazon.com 2nd (79.4), walmart.com 3rd (73.8), target.com 4th (71.2), uniqlo.com 5th (65.6).

An example share card comparing five major US retailers. ikea.com leads on Core Web Vitals with a score of 93, ahead of amazon.com (80), walmart.com (74), target.com (72) and uniqlo.com (66). Every comparison generates one of these automatically.

Use it to:

Free, no sign-up required.

Try Compare Website Speed.

CLI 7.0: RUM, CrUX and a new command structure

CLIAPI

Version 7.0.0 of the Calibre CLI and Node.js API is a major release that brings Real User Metrics and Chrome User Experience Report data to the command line.

Now you can access RUM origin-level and page-level metrics, including live visitor counts, Web Vitals, UX ratings, and historical trends.

# Overall site performance summarised
calibre rum summary --site my-site

# See performance for each page
calibre rum pages --site my-site

# and more…

Similar calibre crux summary, calibre crux urls and calibre crux url commands are available for CrUX data.

❯ calibre crux urls --site maap
✔ CrUX Assessment: Fail
Form factors: desktop 43.7% | phone 55.3% | tablet 1.1%

METRIC                    | P75
Cumulative Layout Shift   | 0.52
First Contentful Paint    | 1.33 sec
Interaction to Next Paint | 187 ms
Largest Contentful Paint  | 1.96 sec
Time to First Byte        | 359 ms
Image Load Delay          | 1.04 sec
Image Load Duration       | 286 ms
Image Render Delay        | 246 ms
Time to First Byte        | 418 ms
Round Trip Time           | 96 ms

Like all other commands, you can use --json to get machine-readable output for use in scripts and code agents.

7.0.0 release highlights#

  • calibre rum - access Real User Metrics data from your sites
  • calibre crux - access origin-level and URL-level Core Web Vitals from the Chrome User Experience Report, automatically collected by Calibre
  • calibre synthetic - existing synthetic monitoring commands are now namespaced under calibre synthetic
  • calibre deploy - deploy commands elevated to their own top-level namespace
  • calibre site list - now shows which data sources (Synthetic, CrUX, RUM) are active per site
  • calibre metric-list --type - filter metrics by data source (synthetic, crux, or rum)
  • Node.js API - new Crux and Rum programmatic exports

Deprecated aliases with warnings are provided for all moved commands, so existing scripts will continue to work while you migrate.

Using these new commands, you gain programmatic access to all your sites performance data. You can use this to build custom reports, integrate with other tools, or use code agents to interpret performance data and make recommendations.

See the full changelog on GitHub and CLI command documentation for detailed reference.

Chrome 147 & Lighthouse 13.1.0

Test Agent

Our Test Agents are now using Chrome 147 and Lighthouse 13.1.0 to test your Sites.

New: Baseline audit#

This release introduces a new Baseline audit powered by Google Baseline. The audit detects web platform features in use on your pages and reports how well supported they are across browsers.

Each feature is checked against Baseline compatibility data, giving you a clear view of which features are widely supported, which are newly available, and which may still have limited browser support.

The Baseline Features audit listing web features such as requestidlecallback, beforeunload and scrollend with their Baseline status and source URLs

The Baseline audit shows detected web platform features alongside their browser support status.

This helps you make informed decisions about which features to use, and where polyfills or fallbacks might still be needed.

All-new documentation

New feature

We’ve rebuilt the Calibre documentation from the ground up. The new docs are faster to navigate, easier to search and designed for clarity.

Calibre’s redesigned documentation site showing the home page with structured navigation, search and getting started guides

What’s new#

  • Real User Monitoring documentation: Comprehensive new guides covering Calibre RUM installation, configuration, and data privacy
  • Automatic light and dark themes: The docs follow your system preference
  • Better navigation: A restructured sidebar and page layout make it easier to find what you need
  • All-new search: Faster, higher quality results help you get to the right answer quickly
  • Improved readability: Refined typography, spacing and formatting

Of course, the new docs site is faster than ever

Explore the new docs at calibreapp.com/docs.

Introducing Real User Monitoring (RUM)

New FeatureReal User Monitoring

Understanding how your site performs in the real world is critical to delivering a fast, engaging experience. What actually happens when people visit? Does the page load quickly and smoothly? Without unexpected movement or interaction delays? Which pages are slowest? Are users having a good time?

Today, we’re launching Calibre RUM, which captures Core Web Vitals and key UX signals directly from real browser sessions. Now, you can see exactly where your site is fast, where it’s slow, and who is affected.

Calibre RUM Dashboard showing live visitors, total sessions, audience locations, and Core Web Vitals trend charts for LCP, CLS and INP

The RUM Dashboard shows live visitor counts, session totals, audience locations, and Core Web Vitals trends at a glance.

Find the pages that matter most#

The Pages Leaderboard ranks your pages by traffic volume. You can sort by any metric (LCP, INP, CLS, or others) to find the pages with the worst user experience. Group pages by URL pattern (like /blog/* or /products/*) to see how vital sections of your site perform.

No guesswork. Start with the pages that affect the most users. Fix them, iterate.

RUM Pages Leaderboard sorted by sessions, showing performance of the most trafficked pages.

Pages ranked by traffic volume, with Core Web Vitals scores for each.

See which elements are slow#

Calibre RUM identifies the specific DOM elements responsible for slow renders (LCP), interaction delays (INP), and layout shifts (CLS). Add custom attribution with data-name or elementtiming attributes so it’s clear which element or image is causing them problem.

INP Attribution Targets view showing the most problematic interactive elements ranked by interaction delay.

INP Attribution Targets identifies which interactive elements cause the longest delays.

Understand your audience#

The Audience Report shows what percentage of visitors had a good, to improve, or poor experience. It segments UX experience by page, page grouping, element, country, device type, browser, and more. You’ll see which areas are affected the most, and what’s worth investigating further.

Audience Experience report showing quality of user experience by country.

See where user experience is strong and where it suffers, segmented by country, device, browser and more.

Privacy-first by design#

Calibre RUM collects no cookies, no personal data, and no IP addresses. Session identifiers live in sessionStorage and are discarded when the tab closes. The script supports signature-based subresource integrity (SSRI) to prevent supply-chain tampering, and you can optionally exclude EEA/EU visitors entirely. Learn about data collection, processing, retention, and more.

Predictable, controllable costs#

You set the session sampling rate and data retention period. Monitor at a level that matches your requirements, and budget. Sample by 15% of user sessions or 100%. Hard stop billing, or flexible, it’s up to you.

Get started in minutes#

RUM is included on Free Trial, Starter, Team, and Company plans.

Navigate to Site → Real User Monitoring → Settings to enable it, or read the installation guide or documentation.

You can also read more about the launch in our blog post.

Updated legal and security documentation

LegalPrivacySecurity

We’ve updated our Terms of Service, Privacy Policy, Data Protection & Compliance, and Security pages alongside a revised Data Processing Agreement.

These updates reflect the addition of Real User Monitoring (RUM) to Calibre’s product suite.

Because RUM collects performance data from real visitor sessions on your website, our legal and security documentation needed to clearly describe how that data is collected, processed, stored, and protected — and what your responsibilities are as a customer deploying RUM.

We also took the opportunity to trim our sub-processor list (removals only, no new additions), and expanded our security page to reflect the full scope of our technical and organisational safeguards.

If you have questions about any of these changes, or want a copy of the revised Data Processing Agreement, contact us at privacy@calibreapp.com.

Chrome 146

Test Agent

Our Test Agents are now using Chrome 146 to test your Sites.

Chrome 145

Test Agent

Our Test Agents are now using Chrome 145 to test your Sites.

CrUX Pages: Automatic page discovery

New FeatureCrUX

Figuring out which of your pages appear in Google’s Chrome User Experience Report (CrUX) has always meant manual work. Your site might have thousands of pages, but only a subset shows up in the CrUX dataset. Until now, identifying and tracking which URLs to monitor was on you.

Today, Calibre handles that automatically. Automatic page discovery for CrUX Pages finds the most important URLs on your site and tracks them, so you always have up-to-date, real-user performance data with zero manual setup.

CrUX Pages Leaderboard for maap.cc showing automatically discovered pages including Tour Down Under cycling event content with Core Web Vitals scores

Calibre discovers new pages as they're published. Here, recent "Tour Down Under" cycling event product collection page is automatically surfaced with real-user metrics only a few days after launch.

How it works#

Calibre periodically spiders your website to build a map of your most important pages. We look at signals like navigation placement and internal link structure to determine which pages are most important, just like real users would when navigating your site.

Those pages are then matched against Google’s CrUX dataset. Pages with sufficient traffic to appear in CrUX are automatically tracked and kept up to date.

If a page doesn’t receive enough traffic to meet Google’s eligibility thresholds, it won’t appear in CrUX Pages. This is a limitation of the CrUX dataset itself.

Inspecting Interaction to Next Paint (INP) metric shows which Pages have the worst overall INP performance, so its easy to identify which Pages need attention most.

Inspecting Interaction to Next Paint (INP) metric shows which Pages have the worst overall INP performance, so its easy to identify which Pages need attention most.

What you get#

With automatic CrUX Pages discovery, you can:

  • See Core Web Vitals data for your most important pages, without manually auditing your site or guessing which URLs to track
  • Stay on top of performance as your site evolves and new pages gain traffic
  • Identify SEO risk across pages that matter, ranked by real-user experience
  • Filter by device type and customise which metrics appear

Available on all plans#

CrUX Pages with automatic page discovery is available on all Calibre plan tiers. No configuration, or upgrades needed.

View your pages by navigating to Site → CrUX → Pages, or learn more about the CrUX Pages Leaderboard.