App Center Test task

TFS 2017

This task lets you run test suites against an application binary (.apk or .ipa file) using App Center Test.

• Sign up with App Center first.
• For details about using this task, see the App Center documentation article Using Azure DevOps for UI Testing.

Note

In Microsoft Team Foundation Server (TFS) 2018 and previous versions, build and release pipelines are called definitions, runs are called builds, service connections are called service endpoints, stages are called environments, and jobs are called phases.

Arguments

Argument	Description
app Binary application file path	(Required) Relative path from the repo root to the APK or IPA file that you want to test. Argument alias: appFile
artifactsDir Artifacts directory	(Required) Where to place the artifacts produced by the prepare step and used by the run step. This directory will be created if it does not exist. Default value: $(Build.ArtifactStagingDirectory)/AppCenterTest Argument alias: artifactsDirectory
enablePrepare Prepare tests	(Optional) Specify whether to prepare tests. Default value: true Argument alias: prepareTests
framework Test framework	(Required) Options: appium, calabash, espresso, uitest (Xamarin UI Test), xcuitest. Default value: appium Argument alias: frameworkOption
appiumBuildDir Build directory (Appium)	(Required) Path to directory with Appium tests. Argument alias: appiumBuildDirectory
espressoBuildDir Build directory (Espresso)	(Optional) Path to Espresso output directory Argument alias: espressoBuildDirectory
espressoTestApkPath Test APK path (Espresso)	(Optional) Path to APK file with Espresso tests. If not set, build-dir is used to discover it. Wildcard is allowed. Argument alias: espressoTestApkFile
calabashProjectDir Project directory (Calabash)	(Required) Path to Calabash workspace directory. Argument alias: calabashProjectDirectory
calabashConfigFile Cucumber config file (Calabash)	(Optional) Path to Cucumber configuration file, usually cucumber.yml.
calabashProfile Profile to run (Calabash)	(Optional) Profile to run. This value must exists in the Cucumber configuration file.
calabashSkipConfigCheck Skip Configuration Check (Calabash)	(Optional) Force running without Cucumber profile. Default value: false
uitestBuildDir Build directory (Xamarin UI Test)	(Required) Path to directory with built test assemblies Argument alias: uiTestBuildDirectory
uitestStorePath Store file (Xamarin UI Test)	(Optional) Path to the store file used to sign the app.
uitestStorePass Store password (Xamarin UI Test)	(Optional) Password of the store file used to sign the app. Use a new variable with its lock enabled on the Variables tab to encrypt this value. Argument alias: uiTestStorePassword
uitestKeyAlias Key alias (Xamarin UI Test)	(Optional) Enter the alias that identifies the public/private key pair used in the store file
uitestKeyPass Key password (Xamarin UI Test)	(Optional) Enter the key password for the alias and store file. Use a new variable with its lock enabled on the Variables tab to encrypt this value. Argument alias: uiTestKeyPassword
uitestToolsDir Test tools directory (Xamarin UI Test)	(Optional) Path to directory with Xamarin UI test tools that contains test-cloud.exe Argument alias: uiTestToolsDirectory
signInfo Signing information (Calabash/Xamarin UI Test	(Optional) Use Signing Information for signing the test server.
xcuitestBuildDir Build directory (XCUITest)	(Optional) Path to the build output directory, usually $(ProjectDir)/Build/Products/Debug-iphoneos). Argument alias: xcUITestBuildDirectory
xcuitestTestIpaPath Test IPA path (XCUITest)	(Optional) Path to the *.ipa file with the XCUITest tests. Argument alias: xcUITestIpaFile
prepareOpts Additional options (for preparing tests)	(Optional) Additional arguments passed to the App Center test prepare step. Argument alias: prepareOptions
enableRun Run tests	(Optional) Specify whether to run the tests. Default value: true Argument alias: runTests
credsType Authentication method	(Required) Use App Center service connection or enter credentials to connect to App Center. Default value: serviceEndpoint Argument alias: credentialsOption
serverEndpoint App Center service connection	(Required) Select the service connection for App Center. Create a new App Center service connection in Azure DevOps project settings.
username App Center username (when not using a service connection)	(Required) Visit https://appcenter.ms/settings/profile to get your username.
password App Center password (when not using a service connection)	(Required) Visit https://appcenter.ms/settings/profile to set your password. It can accept a variable defined in build or release pipelines as $(passwordVariable). You may mark variable type as secret to secure it.
appSlug App slug	(Required) The app slug is in the format of {username}/{app_identifier}. To locate {username} and {app_identifier} for an app, click on its name from https://appcenter.ms/apps, and the resulting URL is in the format of https://appcenter.ms/users/{username}/apps/{app_identifier}.|
devices Devices	(Required) String to identify what devices this test will run against. Copy and paste this string when you define a new test run from App Center Test beacon.
series Test series	(Optional) The series name for organizing test runs (e.g. master, production, beta). Default value: master
dsymDir dSYM directory	(Optional) Path to iOS symbol files. Argument alias: dsymDirectory
locale System language	(Required) Options: da_DK, de_DE, en_GB, en_US, es_ES, es_MX, fr_FR, ja_JP, nl_NL, ru_RU, user. If your language isn't an option, use user/Other and enter its locale below, such as en_US. Default value: en_US Argument alias: localeOption
userDefinedLocale Other locale	(Optional) Enter any two-letter ISO-639 language code along with any two-letter ISO 3166 country code in the format [language]_[country], such as en_US.
loginOpts Additional options for login	(Optional) Additional arguments passed to the App Center login step. Argument alias: loginOptions
runOpts Additional options for run	(Optional) Additional arguments passed to the App Center test run. Argument alias: runOptions
async Do not wait for test result	(Optional) Specify whether to execute tests asynchronously, exiting just after tests are uploaded, without waiting for test results. Default value: false Argument alias: skipWaitingForResults
cliLocationOverride App Center CLI location	(Optional) Path to the App Center CLI on the build or release agent. Argument alias: cliFile
debug Enable debug output	(Optional) Add --debug to the App Center CLI for verbose output. Argument alias: showDebugOutput

Example

This example runs Espresso tests on an Android app using the App Center Test task.

steps:
- task: AppCenterTest@1
  displayName: 'Espresso Test - Synchronous'
  inputs:
    appFile: 'Espresso/espresso-app.apk'
    artifactsDirectory: '$(Build.ArtifactStagingDirectory)/AppCenterTest'
    frameworkOption: espresso
    espressoBuildDirectory: Espresso
    serverEndpoint: 'myAppCenterServiceConnection'
    appSlug: 'xplatbg1/EspressoTests'
    devices: a84c93af

Open source

This task is open source on GitHub. Feedback and contributions are welcome.

FAQ