Testing Microsoft Store apps
TFS 2017 | TFS 2015
Visual Studio 2017 | Visual Studio 2015
Note
Microsoft Test Manager has been deprecated. It has been replaced with Azure Test Plans, a fully featured test management solution. Microsoft Test Manager 2017, which shipped with Microsoft Visual Studio 2017, is the last version available.
You have two options if you want to test Microsoft Store apps on a phone, tablet, or other device:
Plan and perform your tests using the web portal, using a browser on the device or on another computer. When you use the web portal for testing, the test runner doesn't interact with the software that you're testing; it simply acts as a checklist of the test steps. Therefore, you don't have to run it on the device that you're testing.
This option requires no special preparation on the device, other than installing the software.
Couple the device to your computer, and run the tests using Microsoft Test Manager. This option allows you to capture screenshots and collect diagnostic data from the device.
To use all the features described in this article, you must have one of the following subscriptions:
Or, configure Basic + Test Plans access level.
See Manual testing permissions and access.
Prepare the Windows device for testing
If possible, use the same user credentials or the same Microsoft Live ID on the Windows device and on the computer that is running Microsoft Test Manager. If the user is different, the machine that you are running Microsoft Test Manager from will display a credentials dialog box when you try to connect.
Install the Remote Debugger on the device that you want to test. See Installing the Remote Debugger. (This is only supported for Windows client operating systems. Windows Server 2012 is not supported.)
The Microsoft Test Tools Adapter Configuration Tool will appear on the device as a new tile.
Choose the Microsoft Test Tools Adapter Configuration Tool tile in Windows.
Choose Start Service in the configuration dialog box for Microsoft Test Tools Adapter to configure the Microsoft Test Tools Adapter.
Connect to the remote device
On the machine that you are testing from, open Microsoft Test Manager.
Create some test cases if you haven't already done so.
On the Run Tests page, choose the Modify link next to Perform tests using: to specify the remote Windows device.
Choose the Remote device option and enter the name of the device that you want to test.
By default, port 6905 is used by Microsoft Test Manager to communicate with remote devices. If you want to use a different port, enter the remote device as deviceName:port. For example,
mySlateDevice1:8001. You must also change the port on the remote device by opening the service configuration file mttaservice.exe.config in the Visual Studio installation folder.Choose the Test link to verify that Microsoft Test Manager can communicate with the remote device.
Install your Microsoft Store app
Choose Install Microsoft Store App, and then enter the path and name of the .appx file for the Microsoft Store app that you want to install.
Follow the steps in the installation wizard.
Test your Microsoft Store app
Choose Start Test.
Test Runner opens.
Perform the steps in the test on the remote device.
As you complete each step of the test, mark it passed or failed on the host computer.
The following features are supported while you test on a Windows Remote device:
Feature Support System info Yes Capture screenshot Yes Event logs Yes. Action record/playback Windows Web apps - Yes.
Windows desktop and store apps - No.Create a bug Yes Create environment snapshot of the servers in an SCVMM lab environment. Yes
Security
Verify that the share location where the .appx file and certificates are stored is properly secured.
Help and support
Report any problems on Developer Community, get advice on Stack Overflow, and get support via our Support page.