Flaky test report card, pytest plugin and more
Discover more from Aviator Updates
Flaky test report card, pytest plugin and more
pytest support for flaky tests, Slack support for onprem, UX improvements
Happy Thanksgiving to our extended Aviator family! There’s no better time to tell you how grateful we are for all of you. Enjoy your holiday! 🥧 🍁 🙏
Highlights
🚀 Flaky tests report card
🚀 Flaky tests pytest plugin
🚀 Slack for on-prem
🚀 Queued Page UX Updates
New features
Flaky tests report card
Now, via Aviator’s Slack integration, users can receive a daily summary of the status of their starred tests.
This currently includes the following metrics:
the number of flaky runs today
the most flaky test case of the day
any new flaky tests that have flaked for the first time today
Pytest Plugin
We have released our Pytest plugin that helps rerun flaky tests. Our open source code is here: https://github.com/aviator-co/pytest-aviator.
Slack Integration for on-prem
Our on-prem customers can now use Aviator’s Slack integration. Follow the instructions in our documentation in order to set up notifications and DMs for your queued, blocked, and merged PRs.
New API
We’ve added a new GET branches API to fetch the status (paused/unpaused) of all branches in a repo. See our API documentation for more details.
Queued Page UX Updates
We now show the “elapsed time” for a PR on the Queued page, along with a message that indicates if all tests have passed. This should provide more information about the state of the queue and help with debugging stuck PRs.
Bug fixes and improvements
Rate limit improvements.
Fixed bug in pausing/unpausing repos from UI and API.
Queued page fixes: PR ordering, show required tests.
Merge conflict links will be valid for 48 hours.
Mark PR as blocked if it’s updated in the queue.
Batching improvements: update sticky comments for all batched PRs and fixed comment display.
Added missing reset stats to the Analytics page.
Fixed bug of incorrectly reporting merge conflicts when PRs are resynced.