Reporting on testing progress for test plans
You can track your progress for your test suites immediately after you run your tests from Microsoft Test Manager. You can view your progress in the Run Tests activity for each test suite individually. You can view the tests that have passed and failed. You can mark tests as blocked or reset tests to active when you are ready to run them again, as shown in the following illustration.
.png "View Test Results")
Requirements
- Visual Studio Ultimate, Visual Studio Premium, Visual Studio Test Professional
Note
You can also view this progress for each test suite from the Contents activity when you plan your testing.
If you want to view the results for all the suites in the test plan rolled up for your overall status, you can see this in the Properties view of your test plan in Test Plan Status.
You can also track the progress of your testing efforts by creating your own reports or by using predefined test reports. The predefined reports are available only when your team uses Microsoft Test Manager to create test plans and run tests. The data for the reports is automatically collected as you run tests and save test results.
The predefined reports are created in Excel and a subset of them is also created in Report Designer. If you create your own tests, you can use either Excel or Report Designer.
Note
When you use these predefined reports or create your own reports, there is a time delay between the time that you save the test results and the time that the data is available in the warehouse database or the analysis services database in Team Foundation Server.
You can access test reports in one of three different ways, depending on your preference:
Test Dashboard If your team uses a project portal, you can view the predefined reports on the Test Dashboard. You can access the project portal from the Track view in Microsoft Test Manager. For more information about the Test Dashboard, see Test dashboard (Agile).
Team Explorer You can access Report Designer reports from the Reports folder for your team project, and you can access Excel reports from the Documents folder.
Team Web Access If you have access to Team Web Access, just as with Team Explorer, you can access Report Designer reports from the Reports folder for your team project, and you can access Excel reports from the Documents folder.
The following illustration shows how test points are created in your test plan based on your test cases and test configurations for each test suite. A test point is a pairing of a test case with a test configuration. When you run a set of test points, a test run is created that has a test result for each test point. These test runs are stored in Team Foundation Server. You can then use predefined reports to show your progress based on these test points, or you can create custom reports.
.png "Report on Testing Progress")
Tasks
Use the following topics to help you track your software quality:
Tasks |
Associated Topics |
|---|---|
Tracking how many test cases are ready to run: You can view the progress on how many test cases are ready to run and how many have to be finished for a given timeframe. |
|
Tracking your test plan progress: You can use the Test Plan Progress report to determine, for a given time frame, how many test cases were never run, blocked, failed, or passed. |
|
Tracking progress on testing user stories: The User Story Test Status report shows how many tests have never run, are blocked, failed, or passed for each user story. |
|
Tracking regression: The Failure Analysis report shows the number of distinct configurations for each Test Case that previously passed and are now failing, for the past four weeks. |
|
Tracking how all runs for all plans are doing: You can use the Test Activity report to see how many test runs for all test cases never ran, were blocked, failed, and passed. |
|
Create custom test reports: You can create your own custom reports in either Excel or Report Designer, whichever you are most familiar with. |
External resources
Guidance
Testing for Continuous Delivery with Visual Studio 2012 – Chapter 4: Manual System Tests
See Also
Concepts
Create, customize, and manage reports for Visual Studio ALM