Why do my tests fail?


In performance testing, it’s natural to encounter failed tests from time to time. There’s a variety of reasons why tests might not be completed successfully—from networking, firewalls, HTTP responses, incorrect markup to timeouts caused by poor performance. Ideally, we can spot and address failures quickly, so there’s no disruption to our monitoring and data.

Here are the most common test failure reasons in Calibre and steps to mitigate them.

Test failure messageMitigation steps
Authentication Error: Calibre was unable to authenticate the page (AUTH_ERROR).Make sure that the authentication settings are correct. Pay special attention to form selectors, semantic HTML markup or possible firewall issues. See Authenticating Calibre for more guideance on debugging.
Timeout Error: Test did not complete within the allotted time (RUN_TIMEOUT).Make sure the page responds and completes loading within 300 seconds.
Test Error: Calibre was unable to analyse the page (REPORTER_ERROR or ENVIRONMENT_ERROR).Try running another Snapshot. If the issue persists, contact support.
Test Error: Calibre was unable to analyse the page (PROTOCOL_TIMEOUT).Try running another Snapshot. If the issue persists, contact support.
Page Load Error: Page did not load and was unable to be tested (CHROME_INTERSTITIAL_ERROR or ERRORED_DOCUMENT_REQUEST).Make sure that the page URL is correct.
Page Load Error: DNS servers could not resolve the provided domain (DNS_FAILURE).Make sure that the page URL is correct.
Page Load Error: Page did not load and was unable to be tested (NO_FCP).Make sure that the URLs are correct and the page loads successfully.
Page Load Error: Security errors were detected and prevented the page from loading (INSECURE_DOCUMENT_REQUEST).Make sure that the page loads successfully.
Page Load Error: No visual change detected during page load (SPEEDINDEX_OF_ZERO).Make sure that the page loads successfully.
Page Load Error: Page did not load and was unable to be tested (FAILED_DOCUMENT_REQUEST).Make sure that the page responds with a successfull HTTP status code (2xx). Check if the URLs are correct, there are no redirects, server-side errors, or a firewall blocking Calibre requests. See Recognising the Calibre Agent for more details on how to make sure Test Agent traffic is allowed.

Getting Help

If none of the above mitigation strategies resolve the errors you are seeing, reach out to our technical support team for further assistance.