Prevent Your Tests from Failing, Find Out Worst-Performing Pages and More

Karolina Szczur

August 13, 2020

Release Notes is a monthly summary of new features, product improvements and upcoming releases.

Prevent your tests from failing

There’s a variety of reasons why tests might not be completed successfully—from networking, firewalls, HTTP responses, incorrect markup to timeouts caused by poor performance. Ideally, we spot and address persistent failures quickly, so there’s no disruption to our monitoring and data.

For that exact reason, we introduced Snapshot Failure Emails that alert you when tests are not completing. We will also let you know when tests are running smoothly again.

See detailed information about why your test might not have completed successfully.

Anyone can subscribe to Snapshot Failure alerts in Profile → Email Notifications. In case you didn’t see it, we also documented the most common test error types, so you can debug the reasons behind failures more quickly, too.

Choose deployment provider in Pull Request Reviews

Suppose you are using multiple deployment methods for GitHub repositories connected to Pull Request Reviews. In that case, you can now choose the provider that should be used as a basis for performance comparison.

Selecting a deployment provider when many are present will ensure the most accurate results in your performance reports. You can choose a provider in Site → Settings → Integrations → GitHub.

New documentation: Metric explanations and recommended ranges

We spent time updating documentation around performance metrics to include the most up-to-date recommendations. Find the definitions of all metrics available in Calibre as well as metrics which are not recommended for tracking in Metric Overview.

If you ever spent time looking for recommended ranges for paint metrics, you can now find them on Paint Metrics page. We also added expanded definitions of Core Web Vitals: Total Blocking Time, Largest Contentful Paint and Cumulative Layout Shift.

Upcoming releases: Find out the worst-performing Pages and track KPIs

Soon, we will be surfacing information about Pages in one place, so you can easily find the best and worst-performing ones. On Pages dashboard, each Page can be ranked based on three key metrics. That way, you can identify which areas of your Site need more work and if key pages are not as fast as they should.

Easily see which Pages within your Sites perform the worst.

The Pages dashboard will be set up with three key metrics of Performance Score, First Contentful Paint and Time to Interactive. You can customise the metric set accordingly to your needs and KPIs, for example, by choosing Core Web Vitals.

Customise which KPI metrics are shown on the Pages dashboard.

In the future, we are planning to add metric customisation options throughout the application as each team or organisation have different goals that also require different measurements to quantify their success.

Karolina Szczur

Karolina is the Product Design Lead at Calibre. With years of design experience under her belt, she’s responsible for the comprehensive user experience spanning over product, visuals and content. Find her on Twitter or LinkedIn.

Subscribe to Release Notes to hear what’s new in Calibre

We will send you our latest web performance articles           and notifications about new Calibre features.