Options for regression testing
When Microsoft updates Dynamics 365, you need to make sure that your solution still works as expected. You don't want to introduce any bugs or errors that could affect your users or customers. Microsoft does regression testing, but the data composition, specific customer configurations, and unique extensions mean customers must perform their own regression testing in their own environment.
But regression testing can take a lot of time and effort if you do it manually. You can save time and resources by automating your regression testing with a tool. Many tools are available for regression testing, both from Microsoft and other providers. How do you choose the best one for your needs?
Compare different tools for regression testing
The following table shows some of the tools that you can use for regression testing. It also shows whether they're free or paid, and whether they support different types of testing, such as web, desktop, or mobile.
Learn more about each tool:
-
TheTestMart is a cloud-based code-free test automation platform that focuses on scaling up automation coverage and productivity across core business platforms by applying command-driven techniques.
-
Leapwork Test Automation automates testing across Dynamics 365, Azure, or Power Platform along with the rest of the tech stack. Build, maintain, and scale automation faster with its AI-powered visual test automation platform.
Microsoft Regression suite automation tool (RSAT)
Microsoft RSAT significantly reduces the time and cost of user acceptance testing (UAT) of finance and operations apps. RSAT is fully integrated with Microsoft Azure DevOps for test execution, reporting, and investigation.
-
Microsoft EasyRepro is a library with tools to facilitate automated UI testing for projects with Dynamics 365 Online version 9.0 or 9.2. These APIs provide an easy to use set of commands that make setting up UI testing quick and easy.
-
Microsoft Playwright is a framework for web testing and automation. It allows testing Chromium, Firefox, and WebKit with a single API. Playwright is built to enable cross-browser web automation.
-
Selenium is an umbrella project for a range of tools and libraries that enable and support the automation of web browsers. Primarily used for front-end testing of websites, it's a browser user agent library.
-
Tricentis Tosca helps enterprises plan, construct, stabilize, and execute resilient automated regression tests for Microsoft Dynamics 365 apps.
-
Executive Automats 365 allows you to significantly shorten the test procedure and increase its accuracy. Executive Automats offers fully repeatable, customizable, 100% codeless, and cross-platform testing that translates into tangible benefits for the company.
Consider the costs and benefits of each tool
Before you decide on a tool, you should evaluate how well it meets your business needs. You should consider the following factors:
- The installation and setup of the tool
- The ease and speed of creating and updating test cases
- The product support and documentation available
- The ongoing maintenance and updates of the tool
Some tools are free, but they might require more technical skills or manual work. Some tools are paid, but they might offer more features or support. You should compare the total cost of ownership (TCO) and the return on investment (ROI) of each tool for your scenario. The best tool for you might not be the cheapest one—or the most expensive.
Make your own choice based on your situation
Every organization has a unique environment and profile. That's why Microsoft doesn't recommend one tool over another. You should choose the tool that works best for your solution, your budget, and your goals. You can use the information and links in this article as a starting point for your research.
Give us your feedback
If you have any suggestions or corrections for this article or the list of tools, let us know at RTChartFeedback@microsoft.com.
We can't reply to all messages, but we appreciate your feedback, and we'll review it as soon as possible.
Next steps
- Review the Success by Design checklist of the key steps and tasks for your testing process
- Read a case study of how an organization implemented a testing strategy for its Dynamics 365 solution