CLI 5.1.0: Run Pull Request Reviews in CI/CD with one command

The 5.1.0 release of Calibre CLI introduces new commands to help you automate your performance testing with more ease than previously possible.

Pull Request Reviews

Designed for use with CI/CD systems, CLI Pull Request Reviews are a way for Calibre to compare production (or another environment) to a preview deployment (e.g.: your work-in-progress branch). Each Pull Request review generates a comparison report outlining any key changes in site speed, which can be used to make decisions about whether to merge the branch or not.

You can automatically fail builds when performance budgets are no longer met using the --failOnUnmetBudget flag, too!

1calibre site create-pull-request-review \
2  --site "my-shopfront-production" \
3  --title "(feat): add lightbox to PDP" \
4  --url "https://pr-123.example.com" \
5  --branch "feat/add-lightbox-to-pdp" \
6  --sha="1234567890abcdef1234567890abcdef12345678" \
7  --waitForResult \
8  --failOnUnmetBudget \
9  --markdown > comparison_report.md
10

Read the Pull Request Review CLI documentation for more information.

Improved formatting for Single Page tests

We’ve overhauled the Single Page Test summary terminal output to include a test summary including Web Vitals assessment and key request sizes:

Screenshot: Terminal displaying Single Page Test report output

Read the Single Page Test CLI documentation for more information.

Generate a markdown report for Single Page Tests

Single Page Tests now generate a markdown-powered performance report. You can use this output with other tools that support markdown rendering like GitHub, GitLab and Bitbucket to ensure that all the code you release is reviewed for performance and best practices.

Read the updated documentation for calibre test create and calibre test show commands.

Single Page Test webhooks

When creating a Single Page Test, you can now specify a Webhook URL to post test results to. Using this new technique, you can run async tests and have the results delivered to a custom endpoint of your choosing. You can use --webhookSecret to verify the incoming webhook using HMAC.

1npx calibre test create https://calibreapp.com \
2  --location Sydney \
3  --webhookUrl="https://webhooks.example.com" \
4  --webhookSecret="my verification secret"
5

Read the updated documentation for calibre test create command.

Security updates for dependencies

As part of our regular release cycle, we have applied dependency updates that include important security patches to those projects.

Check full changelog on GitHub.

Changelog