Exploratory testing using Microsoft Test Manager

While you work with your application, Microsoft Test Manager (MTM) can record your actions, comments, screenshots and other data. The recording makes it easy to reproduce bugs. And you can quickly play back your tests whenever the application is updated.

Exploring your app

1. Install the latest build of your application. If it’s a desktop application, install it on a machine that has MTM. If it’s a server, you can install it on any other machine, but you’ll want to run the browser or client on the same machine where you have MTM.

   (To manage test machines more effectively, see Test on a lab environment.)

2. Connect MTM to your test plan if you haven’t already. The test plan stores default settings and test results.

3. Start an exploratory test session in Microsoft Test Manager.

   

   Test Runner appears at the side of the screen. It will stay there while you work with your application.

4. Get your app ready to start testing. For example, if it’s a website, start the server.

5. When you’re ready, start recording.

   

6. While you work with the application, add comments and screenshots in the Test Runner window.

   

   Double-click a screenshot if you want to edit it.

7. Create a bug if you find a problem. The bug will automatically include a list of your actions and comments.

   

8. Create a test case.

   Why? When the application is updated, you’ll want to run the test again to make sure everything is still working. With the list of your actions, it’s easy for you or someone else to repeat the same test.

   

   You’ll probably want to use Change Steps to set how many recent actions are included.

9. Pause the recording if you need to attend to something else. You don’t want your emails or passwords included in the recording.

10. Complete your test.

    

    Give your test run a title that expresses the result, such as "Failed to open account" or "Successfully created an order."

11. Review the exploratory tests in this plan to see how well the sprint is progressing.

    

Q & A

How do I enable screen recording during testing?

That’s an option in your test settings. Open Plan, Properties and under Manual runs choose Test settings = <New…>. In the test settings wizard, give the new settings a name. On the Data and Diagnostics page, scroll down and select Screen and Voice recorder. Click Configure if you want to record your voice along with the screen.

Close the test settings and Save and Close the test plan properties. When you start a test, a real-time screen recording will be added.

When you want to run tests without real-time recording, go back to the test plan properties and set Test Settings = <Default>.

Try this next

• Plan manual tests with Microsoft Test Manager

Or, dig deeper:

• Collect more diagnostic data in manual tests

• Test on a lab environment