Configure Test Settings


Test Profiles provide a way for you to set test conditions for your Site that your customers may experience. By configuring Test Profiles, you can emulate popular devices (like iPhones, iPads and Samsung Galaxy phones), throttle network connectivity, set custom headers or cookies, block ads or JavaScript.

Whether you’re looking to replicate the experience of a mobile user on a slow connection or evaluate the impact of third-party scripts, Test Profiles offer the flexibility to tailor your testing environment to your requirements.

Test Profiles can be found for each site in Calibre by navigating to Site → Synthetic → Settings → Test Profiles.

Test Profile list and creation screen

Throttling types and settings

When running performance tests, it’s crucial to apply network settings that accurately reflect the conditions your users may face. Calibre provides two primary modes of throttling—Simulated Throttling and Runtime Throttling.

Simulated throttling

Simulated Throttling is used by PageSpeed Desktop and PageSpeed Mobile device presets, where device and network conditions are emulated after the test has completed. This approach is used by Google Lighthouse and services that rely on Lighthouse, such as Google PageSpeed Insights or performance tests run directly in Google Chrome browser.

Tip

The following test information is not available under Simulated throttling:

  • Request table: request timings
  • Render timeline: screenshot timings

Runtime throttling

Runtime Throttling applies network throttling during each test, providing a more realistic simulation of user conditions. Runtime throttling is used for all Calibre Test Profiles, except for PageSpeed device presets.

Default Test Profiles

When you monitor a new Site, Calibre creates two default Test Profiles automatically:

NameDevice EmulationConnection Speed
PageSpeed Desktop

A desktop class device with simulated network throttling.
Unthrottled CPU. Viewport: 1350×940 px, DPR 1.PageSpeed Desktop
PageSpeed Mobile

A mobile class device with simulated network throttling.
Moto G Power. Viewport: 412×823 px, DPR 1.75.PageSpeed Mobile

Device presets

Device presets are a set of predefined device configurations that include CPU speed, viewport dimensions, pixel ratio, and User-Agent. These presets are based on real-world devices and are used to emulate the experience of browsing your Site on a specific device.

We selected the devices below to reflect market trends in adoption and a diverse set of resolutions, processor capabilities and price ranges. You can use them to experiment different user scenarios.

NameYear of ReleaseViewportSingle Core Score 1
Samsung Galaxy A122020360×800 px149
Samsung Galaxy Tab A720201428×857 px308
Motorola Moto G Power2020415×884 px311
Oppo Reno 72022360×662 px388
iPhone SE2022320×568 px535
Samsung Galaxy A52s2021412×915 px713
iPad Pro (3rd gen)2021834×1075 px1143
iPhone 112019414×896 px1311
iPad (9th gen)2021810×1010 px1326
iPad mini (6th gen)2021744×1133 px1564
iPhone 122020390×664 px1573
iPad Air (5th gen)2022820×1061 px1706

Discontinued device presets

caution

These devices are no longer sold (discontinued). You can still use them for testing, but they will be deprecated in the future. We recommend using devices from the Current Devices section.

NameYear of ReleaseViewportSingle Core Score1
Motorola Moto G42016360×640 px112
Galaxy S52014360×640 px153
Nexus 5X2015412×732 px170
Nexus 6P2015412×732 px207
iPhone 62014375×667 px306
iPhone 72016375×667 px721
iPhone 52012320×568 px754
iPad (4th gen)2012768×1024 px807
iPhone 82017375×667 px909
iPad Pro (1st gen)20161024×1366 px1116

Network connection speed

Calibre limits the bandwidth available to Chrome browser using pre-configured network speed options that best reflect average global connectivity.

LabelLatencyDownstreamThrottling method
PageSpeed Desktop40ms10.24 MB/sSimulated throttling
PageSpeed Mobile150ms1.638 MB/sSimulated throttling (Slow 4G)
No bandwidth throttling--N/A
Regular 2G300ms256 KB/sRuntime throttling
Good 2G150ms460.80 KB/sRuntime throttling
Slow 3G400ms320 KB/sRuntime throttling
Regular 3G300ms768 KB/sRuntime throttling
Good 3G150ms1.57 MB/sRuntime throttling
Emerging markets 3G400ms3.2 MB/sRuntime throttling
Regular 4G170ms12.19 MB/sRuntime throttling
4G LTE70ms24 MB/sRuntime throttling
DSL30ms2.10 MB/sRuntime throttling
WiFi10ms31.46 MB/sRuntime throttling
Cable20ms40 MB/sRuntime throttling

Cookies

Setting custom cookies can be helpful in a variety of scenarios. The most common implementations include:

  • Authenticating Calibre to your web application.
  • Turning off advertising to ease troubleshooting of developer-specific regressions.
  • Testing against an A/B test or staff-shipped feature.

Headers

Custom headers are useful for setting Authorisation headers for basic authentication or for triggering certain conditions for your Pages.

Blocking third party scripts

Calibre automatically detects third party providers during testing, based on a custom instance of Third Party Web dataset. When creating or editing a Test Profile, choose which providers you would like to the requests will be blocked when Snapshots run.

Each provider is listed with a Last Detected date. Some of the registered third parties can no longer be present on your Site but were included in the past. When blocking, make sure to include active third parties for reliable results.

A list of all detected third parties in a test while setting up a Test Profile

We recommend experimenting with turning off:

  • Chat widgets and communication tools.
  • Scripts providing polyfills.
  • Analytics software.
  • Bug tracking scripts.

Blocking requests to nominated hostnames

You can use Host Blocking to block requests to specified hostnames. Block rules are added one host per line, and include the ability to match wildcard subdomains (e.g.: *.example.com).

Blocking JavaScript

Turning off JavaScript is an excellent strategy in discovering potential functionality and accessibility issues when JavaScript execution fails or is not reliable.

When creating or editing a Test Profile, select “Block JavaScript Requests” to ignore all external JavaScript requests. When JavaScript is blocked, all requests except inline script (<script>my script</script>) included on the page will be halted.

Footnotes

  1. A single-threaded processor benchmark test provided by GeekBench aims to estimate how quickly a processor can perform various calculations. The higher the score, the better. 2