Test Results Perspective
The Test Results perspective shows all the fields associated with tests and their results. The Test Results perspective is based on the Test Result relational table that enables reporting on test results as either a property of the tests or as an independent outcome. You can also answer questions about changes to the result outcomes. These ways of reporting on the test results can be to answer the following types of questions:
Which tests are failing in the current build?
In this case, if a test is run multiple times against a build, the answer is based on the latest result for that test using that build.
How many failed results have occurred in the current build?
In this case, if a test is run multiple times against a build, each result is counted separately.
What is the latest result for a particular test across a range of builds and test runs?
In this case, each test can be listed with its corresponding latest result across the selected builds and test runs.
Note
In order to use perspectives with the Team Foundation cube, you must use Microsoft SQL Server 2005 Enterprise Edition or SQL Server 2005 Enterprise (64) Edition on the data tier. SQL Server 2005 Standard Edition that ships as part of Team Foundation Server, does not support the use of perspectives. When you use SQL Server 2005 Standard Edition, the cube elements from all perspectives reside in the Team System data cube.
Measures
The following table describes the measures that are included in the Test Results perspective.
Measure |
Description |
---|---|
Cumulative Result Count |
Counts the latest version of each result in a particular build. |
Latest Result |
Displays the latest results when you use it together with the Test dimension, and displays the latest result of the test. This calculation requires significant computation and should be used when the number of tests being analyzed is constrained. |
Result Count |
Counts all the results individually. |
Result Transition Count |
Counts all the results where the outcome for a result in a particular build changed. |
Shared Dimensions
The following table describes the attributes that are included in the Test Results perspective. You can aggregate the measures along each of these attributes.
Dimension Use |
Dimension |
Description |
---|---|---|
Area |
Area |
The area classification of the test result. If the test result did not specify an area when it was published, the area is set to "Unknown." |
Build |
Build |
Number or name used to uniquely identify the build. |
Build Start Time |
Build |
Date and time the build began. |
Build Type |
Build |
The build type of the build against which the test result was generated. For more information, see Build Perspective. |
Date |
Date |
The date that the test result was generated. |
Date |
Finished Date |
The finish date of the test run that generated the result. |
Build Flavor |
Flavor |
The build flavor of the build against which the test result was generated. For more information, see Build Perspective. |
Iteration |
Iteration |
The area classification of the test result. If the test result did not specify an area when it was published, the area is set to "Unknown." |
Alias |
Owner |
The alias of the author or current owner of the test. |
Person |
Owner |
The name of the author or current owner of the test. |
Platform |
Platform |
The operating system for which the build was made. The possible values include the following:
|
Team Project |
Team Project |
The team project referenced when publishing the load test results. |
ID |
Work Item |
The work item's ID, as assigned when the work item was created. |
Previous State |
Work Item |
The previous state of the work item. |
Work Item Type |
Work Item |
The type of the work item. |
Reason |
Work Item |
The reason that the state of the work item changed. |
Rev |
Work Item |
The revision of the work item. |
State |
Work Item |
The state of the work item. |
Title |
Work Item |
The title of the work item. |
(other) |
Work Item |
Other attributes depending on the process template used to create the team project. For more information, see the "The Work Item Dimension" section of Current Work Item Perspective. |
Test Result Dimensions
The following table lists all dimensions and attributes specific to the test measures in the cube.
Attribute |
Dimension |
Description |
---|---|---|
Machine |
Agent Machine |
The computer on which the test was run. |
Alias |
Assigned To |
The alias of the person the test is assigned to. |
Person |
Assigned To |
The name of the person the test is assigned to. |
Test Category |
Category |
This hierarchy categorizes test results according to the test list in which they are run. This is a parent-child hierarchy, and can be used to drill down into sub-categories of tests, if nested test lists are used when tests are executed and published. For more information, see Test Results Reported. |
Outcome |
Outcome |
The outcome of the test, for example, Passed, Failed, or Inconclusive. |
Outcome Passing |
Outcome |
A flag that is set to True if the outcome of a test is passing, or false if the outcome is anything other than passing. |
Result |
Result |
The name of the test result. |
Test |
Result |
The name of the test that generated the result. For more information, see Test Results Reported. |
Test Description |
Result |
A description of the test associated with the result. For more information, see Test Results Reported. |
Test Result |
Result |
A hierarchy of the Test and Result. This enables drill-down from results for a particular test to the individual results of that test. |
Test Type |
Result |
The type of the test result, for example, Unit Test, Web Test, Load Test. For more information, see Test Results Reported. |
Run |
Run |
The Run Name of the Test Run that generated the test result. For more information, see Test Results Reported. |
Remote Run |
Run |
A flag, either True or False. This indicates whether the test run that produced the result was a remote test run. For more information, see Test Results Reported. |
Alias |
Run By |
The alias of the person or account under which the test was run. For more information, see Test Results Reported. |
Person |
Run By |
The name of the person or account under which the test was run. For more information, see Test Results Reported. |