Test Profiles
Test Profiles allow you to change the conditions that your site is tested under. Calibre can emulate popular devices (like iPhones, iPads and Samsung Galaxy phones), throttle network connectivity, set custom headers or cookies, block ads or the execution of JavaScript.
Test Profiles can be found for each site in Calibre by navigating to Site → Settings → Test Profiles.
Default Test Profiles
When you add Sites, Calibre creates three default Test Profiles automatically:
| Name | Device Emulation | Connection Speed |
|---|---|---|
| Chrome Desktop An average desktop-class device. | No device emulation. 1280×1024 px viewport. | Cable |
| Motorola Moto G Power, 3G connection An average phone with average mobile connectivity. | Motorola Moto G Power. 415×884 px viewport. | Regular 3G |
| iPhone 12, 4G LTE A fast phone with fast mobile connectivity. | Apple iPhone 12. 414×896 px viewport. | 4G LTE |
Device Emulation
We leverage Google Chrome device emulation with a few additional mechanisms to ensure the measured experience is as close to a real device as possible. When Calibre emulates a device, it sets the following:
- Device viewport
- Device User-Agent
- CPU speed
All to reflect the hardware conditions of the selected device.
Current Devices
We selected the devices below to reflect market trends in adoption and a diverse set of resolutions, processor capabilities and price ranges.
| Name | Year of Release | Viewport | Single Core Score1 |
|---|---|---|---|
| Samsung Galaxy A12 | 2020 | 360×800 px | 149 |
| Samsung Galaxy Tab A7 | 2020 | 1428×857 px | 308 |
| Motorola Moto G Power | 2020 | 415×884 px | 311 |
| Oppo Reno 7 | 2022 | 360×662 px | 388 |
| iPhone SE | 2022 | 320×568 px | 535 |
| Samsung Galaxy A52s | 2021 | 412×915 px | 713 |
| iPad Pro (3rd gen) | 2021 | 834×1075 px | 1143 |
| iPhone 11 | 2019 | 414×896 px | 1311 |
| iPad (9th gen) | 2021 | 810×1010 px | 1326 |
| iPad mini (6th gen) | 2021 | 744×1133 px | 1564 |
| iPhone 12 | 2020 | 390×664 px | 1573 |
| iPad Air (5th gen) | 2022 | 820×1061 px | 1706 |
1 A single-threaded processor benchmark test provided by GeekBench aims to estimate how quickly a processor can perform various calculations. The higher the score, the better.
Discontinued Devices
| Name | Year of Release | Viewport | Single Core Score1 |
|---|---|---|---|
| Motorola Moto G4 | 2016 | 360×640 px | 112 |
| Galaxy S5 | 2014 | 360×640 px | 153 |
| Nexus 5X | 2015 | 412×732 px | 170 |
| Nexus 6P | 2015 | 412×732 px | 207 |
| iPhone 6 | 2014 | 375×667 px | 306 |
| iPhone 7 | 2016 | 375×667 px | 721 |
| iPhone 5 | 2012 | 320×568 px | 754 |
| iPad (4th gen) | 2012 | 768×1024 px | 807 |
| iPhone 8 | 2017 | 375×667 px | 909 |
| iPad Pro (1st gen) | 2016 | 1024×1366 px | 1116 |
1 A single-threaded processor benchmark test provided by GeekBench aims to estimate how quickly a processor can perform various calculations. The higher the score, the better.
Emulated Network Connection Speed
Calibre limits the bandwidth available to the browser by using pre-configured network speed options that best reflect average global connectivity.
Those pre-configured options are:
| Label | Latency | Downstream | Upstream |
|---|---|---|---|
| No bandwidth throttling | |||
| Regular 2G | 300ms | 256 KB/s | 51.2 KB/s |
| Good 2G | 150ms | 460.80 KB/s | 153.60 KB/s |
| Slow 3G | 400ms | 320 KB/s | 320 KB/s |
| Regular 3G | 300ms | 768 KB/s | 256 KB/s |
| Good 3G | 150ms | 1.57 MB/s | 768 KB/s |
| Emerging markets 3G | 400ms | 3.2 MB/s | 3.2 MB/s |
| Regular 4G | 170ms | 12.19 MB/s | 3.15 MB/s |
| 4G LTE | 70ms | 24 MB/s | 24 MB/s |
| DSL | 30ms | 2.10 MB/s | 1.05 MB/s |
| WiFi | 10ms | 31.46 MB/s | 15.73 MB/s |
| Cable | 20ms | 40 MB/s | 40 MB/s |
Cookies
Setting custom cookies can be helpful in a variety of scenarios. The most common implementations include:
- Authenticating Calibre to your web application.
- Disabling advertising to ease troubleshooting of developer-specific regressions.
- Testing against an A/B test or staff-shipped feature.
Headers
Custom headers are useful for setting Authorisation headers for basic authentication or for triggering certain conditions for your Pages.
Blocking ads
Advertising often has a significant impact on site speed. When creating a Test Profile, select “Block ads” to analyze the impact on speed and accessibility. Calibre’s ad blocking feature is powered by uBlock.
Blocking third party scripts
Calibre automatically detects third party providers during testing, based on a custom instance of Third Party Web dataset. When creating or editing a Test Profile, choose which providers you would like to the requests will be blocked when Snapshots run.
Each provider is listed with a Last Detected date. Some of the registered third parties can no longer be present on your Site but were included in the past. When blocking, make sure to include active third parties for reliable results.
We recommend experimenting with disabling:
- Chat widgets and communication tools.
- Scripts providing polyfills.
- Analytics software.
- Bug tracking scripts.
Blocking JavaScript
Turning off JavaScript is an excellent strategy in discovering potential functionality and accessibility issues when JavaScript execution fails or is not reliable.
When creating or editing a Test Profile, select “Block JavaScript Requests” to ignore all external JavaScript requests. When JavaScript is blocked, all requests except inline script (<script>my script</script>) included on the page will be halted.