Microsoft.DataFactory factories/pipelines 2017-09-01-preview

• Latest
• 2018-06-01
• 2017-09-01-preview

Bicep resource definition

The factories/pipelines resource type can be deployed with operations that target:

• Resource groups - See resource group deployment commands

For a list of changed properties in each API version, see change log.

Resource format

To create a Microsoft.DataFactory/factories/pipelines resource, add the following Bicep to your template.

resource symbolicname 'Microsoft.DataFactory/factories/pipelines@2017-09-01-preview' = {
  parent: resourceSymbolicName
  name: 'string'
  properties: {
    activities: [
      {
        dependsOn: [
          {
            activity: 'string'
            dependencyConditions: [
              'string'
            ]
          }
        ]
        description: 'string'
        name: 'string'
        type: 'string'
        // For remaining properties, see Activity objects
      }
    ]
    annotations: [
      any(Azure.Bicep.Types.Concrete.AnyType)
    ]
    concurrency: int
    description: 'string'
    parameters: {
      {customized property}: {
        defaultValue: any(Azure.Bicep.Types.Concrete.AnyType)
        type: 'string'
      }
    }
  }
}

CopySink objects

Set the type property to specify the type of object.

SecretBase objects

Set the type property to specify the type of object.

For AzureKeyVaultSecret, use:

{
  secretName: any(Azure.Bicep.Types.Concrete.AnyType)
  secretVersion: any(Azure.Bicep.Types.Concrete.AnyType)
  store: {
    parameters: {
      {customized property}: any(Azure.Bicep.Types.Concrete.AnyType)
    }
    referenceName: 'string'
    type: 'string'
  }
  type: 'AzureKeyVaultSecret'
}

For SecureString, use:

{
  type: 'SecureString'
  value: 'string'
}

CopySource objects

Set the type property to specify the type of object.

Activity objects

Set the type property to specify the type of object.

For AzureMLBatchExecution, use:

{
  linkedServiceName: {
    parameters: {
      {customized property}: any(Azure.Bicep.Types.Concrete.AnyType)
    }
    referenceName: 'string'
    type: 'string'
  }
  policy: {
    retry: any(Azure.Bicep.Types.Concrete.AnyType)
    retryIntervalInSeconds: int
    secureOutput: bool
    timeout: any(Azure.Bicep.Types.Concrete.AnyType)
  }
  type: 'AzureMLBatchExecution'
  typeProperties: {
    globalParameters: {
      {customized property}: any(Azure.Bicep.Types.Concrete.AnyType)
    }
    webServiceInputs: {
      {customized property}: {
        filePath: any(Azure.Bicep.Types.Concrete.AnyType)
        linkedServiceName: {
          parameters: {
            {customized property}: any(Azure.Bicep.Types.Concrete.AnyType)
          }
          referenceName: 'string'
          type: 'string'
        }
      }
    }
    webServiceOutputs: {
      {customized property}: {
        filePath: any(Azure.Bicep.Types.Concrete.AnyType)
        linkedServiceName: {
          parameters: {
            {customized property}: any(Azure.Bicep.Types.Concrete.AnyType)
          }
          referenceName: 'string'
          type: 'string'
        }
      }
    }
  }
}

For AzureMLUpdateResource, use:

{
  linkedServiceName: {
    parameters: {
      {customized property}: any(Azure.Bicep.Types.Concrete.AnyType)
    }
    referenceName: 'string'
    type: 'string'
  }
  policy: {
    retry: any(Azure.Bicep.Types.Concrete.AnyType)
    retryIntervalInSeconds: int
    secureOutput: bool
    timeout: any(Azure.Bicep.Types.Concrete.AnyType)
  }
  type: 'AzureMLUpdateResource'
  typeProperties: {
    trainedModelFilePath: any(Azure.Bicep.Types.Concrete.AnyType)
    trainedModelLinkedServiceName: {
      parameters: {
        {customized property}: any(Azure.Bicep.Types.Concrete.AnyType)
      }
      referenceName: 'string'
      type: 'string'
    }
    trainedModelName: any(Azure.Bicep.Types.Concrete.AnyType)
  }
}

For ExecutePipeline, use:

{
  type: 'ExecutePipeline'
  typeProperties: {
    parameters: {
      {customized property}: any(Azure.Bicep.Types.Concrete.AnyType)
    }
    pipeline: {
      name: 'string'
      referenceName: 'string'
      type: 'string'
    }
    waitOnCompletion: bool
  }
}

For Filter, use:

{
  type: 'Filter'
  typeProperties: {
    condition: {
      type: 'string'
      value: 'string'
    }
    items: {
      type: 'string'
      value: 'string'
    }
  }
}

For ForEach, use:

{
  type: 'ForEach'
  typeProperties: {
    activities: [
      {
        dependsOn: [
          {
            activity: 'string'
            dependencyConditions: [
              'string'
            ]
          }
        ]
        description: 'string'
        name: 'string'
        type: 'string'
        // For remaining properties, see Activity objects
      }
    ]
    batchCount: int
    isSequential: bool
    items: {
      type: 'string'
      value: 'string'
    }
  }
}

For IfCondition, use:

{
  type: 'IfCondition'
  typeProperties: {
    expression: {
      type: 'string'
      value: 'string'
    }
    ifFalseActivities: [
      {
        dependsOn: [
          {
            activity: 'string'
            dependencyConditions: [
              'string'
            ]
          }
        ]
        description: 'string'
        name: 'string'
        type: 'string'
        // For remaining properties, see Activity objects
      }
    ]
    ifTrueActivities: [
      {
        dependsOn: [
          {
            activity: 'string'
            dependencyConditions: [
              'string'
            ]
          }
        ]
        description: 'string'
        name: 'string'
        type: 'string'
        // For remaining properties, see Activity objects
      }
    ]
  }
}

For Until, use:

{
  type: 'Until'
  typeProperties: {
    activities: [
      {
        dependsOn: [
          {
            activity: 'string'
            dependencyConditions: [
              'string'
            ]
          }
        ]
        description: 'string'
        name: 'string'
        type: 'string'
        // For remaining properties, see Activity objects
      }
    ]
    expression: {
      type: 'string'
      value: 'string'
    }
    timeout: any(Azure.Bicep.Types.Concrete.AnyType)
  }
}

For Wait, use:

{
  type: 'Wait'
  typeProperties: {
    waitTimeInSeconds: int
  }
}

For Copy, use:

{
  inputs: [
    {
      parameters: {
        {customized property}: any(Azure.Bicep.Types.Concrete.AnyType)
      }
      referenceName: 'string'
      type: 'string'
    }
  ]
  linkedServiceName: {
    parameters: {
      {customized property}: any(Azure.Bicep.Types.Concrete.AnyType)
    }
    referenceName: 'string'
    type: 'string'
  }
  outputs: [
    {
      parameters: {
        {customized property}: any(Azure.Bicep.Types.Concrete.AnyType)
      }
      referenceName: 'string'
      type: 'string'
    }
  ]
  policy: {
    retry: any(Azure.Bicep.Types.Concrete.AnyType)
    retryIntervalInSeconds: int
    secureOutput: bool
    timeout: any(Azure.Bicep.Types.Concrete.AnyType)
  }
  type: 'Copy'
  typeProperties: {
    cloudDataMovementUnits: any(Azure.Bicep.Types.Concrete.AnyType)
    enableSkipIncompatibleRow: any(Azure.Bicep.Types.Concrete.AnyType)
    enableStaging: any(Azure.Bicep.Types.Concrete.AnyType)
    parallelCopies: any(Azure.Bicep.Types.Concrete.AnyType)
    redirectIncompatibleRowSettings: {
      linkedServiceName: any(Azure.Bicep.Types.Concrete.AnyType)
      path: any(Azure.Bicep.Types.Concrete.AnyType)
    }
    sink: {
      sinkRetryCount: any(Azure.Bicep.Types.Concrete.AnyType)
      sinkRetryWait: any(Azure.Bicep.Types.Concrete.AnyType)
      writeBatchSize: any(Azure.Bicep.Types.Concrete.AnyType)
      writeBatchTimeout: any(Azure.Bicep.Types.Concrete.AnyType)
      type: 'string'
      // For remaining properties, see CopySink objects
    }
    source: {
      sourceRetryCount: any(Azure.Bicep.Types.Concrete.AnyType)
      sourceRetryWait: any(Azure.Bicep.Types.Concrete.AnyType)
      type: 'string'
      // For remaining properties, see CopySource objects
    }
    stagingSettings: {
      enableCompression: any(Azure.Bicep.Types.Concrete.AnyType)
      linkedServiceName: {
        parameters: {
          {customized property}: any(Azure.Bicep.Types.Concrete.AnyType)
        }
        referenceName: 'string'
        type: 'string'
      }
      path: any(Azure.Bicep.Types.Concrete.AnyType)
    }
    translator: any(Azure.Bicep.Types.Concrete.AnyType)
  }
}

For Custom, use:

{
  linkedServiceName: {
    parameters: {
      {customized property}: any(Azure.Bicep.Types.Concrete.AnyType)
    }
    referenceName: 'string'
    type: 'string'
  }
  policy: {
    retry: any(Azure.Bicep.Types.Concrete.AnyType)
    retryIntervalInSeconds: int
    secureOutput: bool
    timeout: any(Azure.Bicep.Types.Concrete.AnyType)
  }
  type: 'Custom'
  typeProperties: {
    command: any(Azure.Bicep.Types.Concrete.AnyType)
    extendedProperties: {
      {customized property}: any(Azure.Bicep.Types.Concrete.AnyType)
    }
    folderPath: any(Azure.Bicep.Types.Concrete.AnyType)
    referenceObjects: {
      datasets: [
        {
          parameters: {
            {customized property}: any(Azure.Bicep.Types.Concrete.AnyType)
          }
          referenceName: 'string'
          type: 'string'
        }
      ]
      linkedServices: [
        {
          parameters: {
            {customized property}: any(Azure.Bicep.Types.Concrete.AnyType)
          }
          referenceName: 'string'
          type: 'string'
        }
      ]
    }
    resourceLinkedService: {
      parameters: {
        {customized property}: any(Azure.Bicep.Types.Concrete.AnyType)
      }
      referenceName: 'string'
      type: 'string'
    }
  }
}

For DataLakeAnalyticsU-SQL, use:

{
  linkedServiceName: {
    parameters: {
      {customized property}: any(Azure.Bicep.Types.Concrete.AnyType)
    }
    referenceName: 'string'
    type: 'string'
  }
  policy: {
    retry: any(Azure.Bicep.Types.Concrete.AnyType)
    retryIntervalInSeconds: int
    secureOutput: bool
    timeout: any(Azure.Bicep.Types.Concrete.AnyType)
  }
  type: 'DataLakeAnalyticsU-SQL'
  typeProperties: {
    compilationMode: any(Azure.Bicep.Types.Concrete.AnyType)
    degreeOfParallelism: any(Azure.Bicep.Types.Concrete.AnyType)
    parameters: {
      {customized property}: any(Azure.Bicep.Types.Concrete.AnyType)
    }
    priority: any(Azure.Bicep.Types.Concrete.AnyType)
    runtimeVersion: any(Azure.Bicep.Types.Concrete.AnyType)
    scriptLinkedService: {
      parameters: {
        {customized property}: any(Azure.Bicep.Types.Concrete.AnyType)
      }
      referenceName: 'string'
      type: 'string'
    }
    scriptPath: any(Azure.Bicep.Types.Concrete.AnyType)
  }
}

For DatabricksNotebook, use:

{
  linkedServiceName: {
    parameters: {
      {customized property}: any(Azure.Bicep.Types.Concrete.AnyType)
    }
    referenceName: 'string'
    type: 'string'
  }
  policy: {
    retry: any(Azure.Bicep.Types.Concrete.AnyType)
    retryIntervalInSeconds: int
    secureOutput: bool
    timeout: any(Azure.Bicep.Types.Concrete.AnyType)
  }
  type: 'DatabricksNotebook'
  typeProperties: {
    baseParameters: {
      {customized property}: any(Azure.Bicep.Types.Concrete.AnyType)
    }
    notebookPath: any(Azure.Bicep.Types.Concrete.AnyType)
  }
}

For ExecuteSSISPackage, use:

{
  linkedServiceName: {
    parameters: {
      {customized property}: any(Azure.Bicep.Types.Concrete.AnyType)
    }
    referenceName: 'string'
    type: 'string'
  }
  policy: {
    retry: any(Azure.Bicep.Types.Concrete.AnyType)
    retryIntervalInSeconds: int
    secureOutput: bool
    timeout: any(Azure.Bicep.Types.Concrete.AnyType)
  }
  type: 'ExecuteSSISPackage'
  typeProperties: {
    connectVia: {
      parameters: {
        {customized property}: any(Azure.Bicep.Types.Concrete.AnyType)
      }
      referenceName: 'string'
      type: 'string'
    }
    environmentPath: any(Azure.Bicep.Types.Concrete.AnyType)
    executionCredential: {
      domain: any(Azure.Bicep.Types.Concrete.AnyType)
      password: {
        type: 'string'
        value: 'string'
      }
      userName: any(Azure.Bicep.Types.Concrete.AnyType)
    }
    loggingLevel: any(Azure.Bicep.Types.Concrete.AnyType)
    logLocation: {
      logPath: any(Azure.Bicep.Types.Concrete.AnyType)
      type: 'string'
      typeProperties: {
        accessCredential: {
          domain: any(Azure.Bicep.Types.Concrete.AnyType)
          password: {
            type: 'string'
            // For remaining properties, see SecretBase objects
          }
          userName: any(Azure.Bicep.Types.Concrete.AnyType)
        }
        logRefreshInterval: any(Azure.Bicep.Types.Concrete.AnyType)
      }
    }
    packageConnectionManagers: {
      {customized property}: {
        {customized property}: {
          value: any(Azure.Bicep.Types.Concrete.AnyType)
        }
      }
    }
    packageLocation: {
      packagePath: any(Azure.Bicep.Types.Concrete.AnyType)
      type: 'string'
      typeProperties: {
        accessCredential: {
          domain: any(Azure.Bicep.Types.Concrete.AnyType)
          password: {
            type: 'string'
            // For remaining properties, see SecretBase objects
          }
          userName: any(Azure.Bicep.Types.Concrete.AnyType)
        }
        configurationPath: any(Azure.Bicep.Types.Concrete.AnyType)
        packagePassword: {
          type: 'string'
          // For remaining properties, see SecretBase objects
        }
      }
    }
    packageParameters: {
      {customized property}: {
        value: any(Azure.Bicep.Types.Concrete.AnyType)
      }
    }
    projectConnectionManagers: {
      {customized property}: {
        {customized property}: {
          value: any(Azure.Bicep.Types.Concrete.AnyType)
        }
      }
    }
    projectParameters: {
      {customized property}: {
        value: any(Azure.Bicep.Types.Concrete.AnyType)
      }
    }
    propertyOverrides: {
      {customized property}: {
        isSensitive: bool
        value: any(Azure.Bicep.Types.Concrete.AnyType)
      }
    }
    runtime: any(Azure.Bicep.Types.Concrete.AnyType)
  }
}

For GetMetadata, use:

{
  linkedServiceName: {
    parameters: {
      {customized property}: any(Azure.Bicep.Types.Concrete.AnyType)
    }
    referenceName: 'string'
    type: 'string'
  }
  policy: {
    retry: any(Azure.Bicep.Types.Concrete.AnyType)
    retryIntervalInSeconds: int
    secureOutput: bool
    timeout: any(Azure.Bicep.Types.Concrete.AnyType)
  }
  type: 'GetMetadata'
  typeProperties: {
    dataset: {
      parameters: {
        {customized property}: any(Azure.Bicep.Types.Concrete.AnyType)
      }
      referenceName: 'string'
      type: 'string'
    }
    fieldList: [
      any(Azure.Bicep.Types.Concrete.AnyType)
    ]
  }
}

For HDInsightHive, use:

{
  linkedServiceName: {
    parameters: {
      {customized property}: any(Azure.Bicep.Types.Concrete.AnyType)
    }
    referenceName: 'string'
    type: 'string'
  }
  policy: {
    retry: any(Azure.Bicep.Types.Concrete.AnyType)
    retryIntervalInSeconds: int
    secureOutput: bool
    timeout: any(Azure.Bicep.Types.Concrete.AnyType)
  }
  type: 'HDInsightHive'
  typeProperties: {
    arguments: [
      any(Azure.Bicep.Types.Concrete.AnyType)
    ]
    defines: {
      {customized property}: any(Azure.Bicep.Types.Concrete.AnyType)
    }
    getDebugInfo: 'string'
    scriptLinkedService: {
      parameters: {
        {customized property}: any(Azure.Bicep.Types.Concrete.AnyType)
      }
      referenceName: 'string'
      type: 'string'
    }
    scriptPath: any(Azure.Bicep.Types.Concrete.AnyType)
    storageLinkedServices: [
      {
        parameters: {
          {customized property}: any(Azure.Bicep.Types.Concrete.AnyType)
        }
        referenceName: 'string'
        type: 'string'
      }
    ]
  }
}

For HDInsightMapReduce, use:

{
  linkedServiceName: {
    parameters: {
      {customized property}: any(Azure.Bicep.Types.Concrete.AnyType)
    }
    referenceName: 'string'
    type: 'string'
  }
  policy: {
    retry: any(Azure.Bicep.Types.Concrete.AnyType)
    retryIntervalInSeconds: int
    secureOutput: bool
    timeout: any(Azure.Bicep.Types.Concrete.AnyType)
  }
  type: 'HDInsightMapReduce'
  typeProperties: {
    arguments: [
      any(Azure.Bicep.Types.Concrete.AnyType)
    ]
    className: any(Azure.Bicep.Types.Concrete.AnyType)
    defines: {
      {customized property}: any(Azure.Bicep.Types.Concrete.AnyType)
    }
    getDebugInfo: 'string'
    jarFilePath: any(Azure.Bicep.Types.Concrete.AnyType)
    jarLibs: [
      any(Azure.Bicep.Types.Concrete.AnyType)
    ]
    jarLinkedService: {
      parameters: {
        {customized property}: any(Azure.Bicep.Types.Concrete.AnyType)
      }
      referenceName: 'string'
      type: 'string'
    }
    storageLinkedServices: [
      {
        parameters: {
          {customized property}: any(Azure.Bicep.Types.Concrete.AnyType)
        }
        referenceName: 'string'
        type: 'string'
      }
    ]
  }
}

For HDInsightPig, use:

{
  linkedServiceName: {
    parameters: {
      {customized property}: any(Azure.Bicep.Types.Concrete.AnyType)
    }
    referenceName: 'string'
    type: 'string'
  }
  policy: {
    retry: any(Azure.Bicep.Types.Concrete.AnyType)
    retryIntervalInSeconds: int
    secureOutput: bool
    timeout: any(Azure.Bicep.Types.Concrete.AnyType)
  }
  type: 'HDInsightPig'
  typeProperties: {
    arguments: [
      any(Azure.Bicep.Types.Concrete.AnyType)
    ]
    defines: {
      {customized property}: any(Azure.Bicep.Types.Concrete.AnyType)
    }
    getDebugInfo: 'string'
    scriptLinkedService: {
      parameters: {
        {customized property}: any(Azure.Bicep.Types.Concrete.AnyType)
      }
      referenceName: 'string'
      type: 'string'
    }
    scriptPath: any(Azure.Bicep.Types.Concrete.AnyType)
    storageLinkedServices: [
      {
        parameters: {
          {customized property}: any(Azure.Bicep.Types.Concrete.AnyType)
        }
        referenceName: 'string'
        type: 'string'
      }
    ]
  }
}

For HDInsightSpark, use:

{
  linkedServiceName: {
    parameters: {
      {customized property}: any(Azure.Bicep.Types.Concrete.AnyType)
    }
    referenceName: 'string'
    type: 'string'
  }
  policy: {
    retry: any(Azure.Bicep.Types.Concrete.AnyType)
    retryIntervalInSeconds: int
    secureOutput: bool
    timeout: any(Azure.Bicep.Types.Concrete.AnyType)
  }
  type: 'HDInsightSpark'
  typeProperties: {
    arguments: [
      any(Azure.Bicep.Types.Concrete.AnyType)
    ]
    className: 'string'
    entryFilePath: any(Azure.Bicep.Types.Concrete.AnyType)
    getDebugInfo: 'string'
    proxyUser: any(Azure.Bicep.Types.Concrete.AnyType)
    rootPath: any(Azure.Bicep.Types.Concrete.AnyType)
    sparkConfig: {
      {customized property}: any(Azure.Bicep.Types.Concrete.AnyType)
    }
    sparkJobLinkedService: {
      parameters: {
        {customized property}: any(Azure.Bicep.Types.Concrete.AnyType)
      }
      referenceName: 'string'
      type: 'string'
    }
  }
}

For HDInsightStreaming, use:

{
  linkedServiceName: {
    parameters: {
      {customized property}: any(Azure.Bicep.Types.Concrete.AnyType)
    }
    referenceName: 'string'
    type: 'string'
  }
  policy: {
    retry: any(Azure.Bicep.Types.Concrete.AnyType)
    retryIntervalInSeconds: int
    secureOutput: bool
    timeout: any(Azure.Bicep.Types.Concrete.AnyType)
  }
  type: 'HDInsightStreaming'
  typeProperties: {
    arguments: [
      any(Azure.Bicep.Types.Concrete.AnyType)
    ]
    combiner: any(Azure.Bicep.Types.Concrete.AnyType)
    commandEnvironment: [
      any(Azure.Bicep.Types.Concrete.AnyType)
    ]
    defines: {
      {customized property}: any(Azure.Bicep.Types.Concrete.AnyType)
    }
    fileLinkedService: {
      parameters: {
        {customized property}: any(Azure.Bicep.Types.Concrete.AnyType)
      }
      referenceName: 'string'
      type: 'string'
    }
    filePaths: [
      any(Azure.Bicep.Types.Concrete.AnyType)
    ]
    getDebugInfo: 'string'
    input: any(Azure.Bicep.Types.Concrete.AnyType)
    mapper: any(Azure.Bicep.Types.Concrete.AnyType)
    output: any(Azure.Bicep.Types.Concrete.AnyType)
    reducer: any(Azure.Bicep.Types.Concrete.AnyType)
    storageLinkedServices: [
      {
        parameters: {
          {customized property}: any(Azure.Bicep.Types.Concrete.AnyType)
        }
        referenceName: 'string'
        type: 'string'
      }
    ]
  }
}

For Lookup, use:

{
  linkedServiceName: {
    parameters: {
      {customized property}: any(Azure.Bicep.Types.Concrete.AnyType)
    }
    referenceName: 'string'
    type: 'string'
  }
  policy: {
    retry: any(Azure.Bicep.Types.Concrete.AnyType)
    retryIntervalInSeconds: int
    secureOutput: bool
    timeout: any(Azure.Bicep.Types.Concrete.AnyType)
  }
  type: 'Lookup'
  typeProperties: {
    dataset: {
      parameters: {
        {customized property}: any(Azure.Bicep.Types.Concrete.AnyType)
      }
      referenceName: 'string'
      type: 'string'
    }
    firstRowOnly: any(Azure.Bicep.Types.Concrete.AnyType)
    source: {
      sourceRetryCount: any(Azure.Bicep.Types.Concrete.AnyType)
      sourceRetryWait: any(Azure.Bicep.Types.Concrete.AnyType)
      type: 'string'
      // For remaining properties, see CopySource objects
    }
  }
}

For SqlServerStoredProcedure, use:

{
  linkedServiceName: {
    parameters: {
      {customized property}: any(Azure.Bicep.Types.Concrete.AnyType)
    }
    referenceName: 'string'
    type: 'string'
  }
  policy: {
    retry: any(Azure.Bicep.Types.Concrete.AnyType)
    retryIntervalInSeconds: int
    secureOutput: bool
    timeout: any(Azure.Bicep.Types.Concrete.AnyType)
  }
  type: 'SqlServerStoredProcedure'
  typeProperties: {
    storedProcedureName: any(Azure.Bicep.Types.Concrete.AnyType)
    storedProcedureParameters: {
      {customized property}: {
        type: 'string'
        value: any(Azure.Bicep.Types.Concrete.AnyType)
      }
    }
  }
}

For WebActivity, use:

{
  linkedServiceName: {
    parameters: {
      {customized property}: any(Azure.Bicep.Types.Concrete.AnyType)
    }
    referenceName: 'string'
    type: 'string'
  }
  policy: {
    retry: any(Azure.Bicep.Types.Concrete.AnyType)
    retryIntervalInSeconds: int
    secureOutput: bool
    timeout: any(Azure.Bicep.Types.Concrete.AnyType)
  }
  type: 'WebActivity'
  typeProperties: {
    authentication: {
      password: {
        type: 'string'
        value: 'string'
      }
      pfx: {
        type: 'string'
        value: 'string'
      }
      resource: 'string'
      type: 'string'
      username: 'string'
    }
    body: any(Azure.Bicep.Types.Concrete.AnyType)
    datasets: [
      {
        parameters: {
          {customized property}: any(Azure.Bicep.Types.Concrete.AnyType)
        }
        referenceName: 'string'
        type: 'string'
      }
    ]
    disableCertValidation: bool
    headers: any(Azure.Bicep.Types.Concrete.AnyType)
    linkedServices: [
      {
        parameters: {
          {customized property}: any(Azure.Bicep.Types.Concrete.AnyType)
        }
        referenceName: 'string'
        type: 'string'
      }
    ]
    method: 'string'
    url: any(Azure.Bicep.Types.Concrete.AnyType)
  }
}

Property values

Activity

Name	Description	Value
dependsOn	Activity depends on condition.	ActivityDependency[]
description	Activity description.	string
name	Activity name.	string (required)
type	Set to 'AzureMLBatchExecution' for type AzureMLBatchExecutionActivity. Set to 'AzureMLUpdateResource' for type AzureMLUpdateResourceActivity. Set to 'ExecutePipeline' for type ExecutePipelineActivity. Set to 'Filter' for type FilterActivity. Set to 'ForEach' for type ForEachActivity. Set to 'IfCondition' for type IfConditionActivity. Set to 'Until' for type UntilActivity. Set to 'Wait' for type WaitActivity. Set to 'Copy' for type CopyActivity. Set to 'Custom' for type CustomActivity. Set to 'DataLakeAnalyticsU-SQL' for type DataLakeAnalyticsUsqlActivity. Set to 'DatabricksNotebook' for type DatabricksNotebookActivity. Set to 'ExecuteSSISPackage' for type ExecuteSsisPackageActivity. Set to 'GetMetadata' for type GetMetadataActivity. Set to 'HDInsightHive' for type HDInsightHiveActivity. Set to 'HDInsightMapReduce' for type HDInsightMapReduceActivity. Set to 'HDInsightPig' for type HDInsightPigActivity. Set to 'HDInsightSpark' for type HDInsightSparkActivity. Set to 'HDInsightStreaming' for type HDInsightStreamingActivity. Set to 'Lookup' for type LookupActivity. Set to 'SqlServerStoredProcedure' for type SqlServerStoredProcedureActivity. Set to 'WebActivity' for type WebActivity.	'AzureMLBatchExecution' 'AzureMLUpdateResource' 'Copy' 'Custom' 'DatabricksNotebook' 'DataLakeAnalyticsU-SQL' 'ExecutePipeline' 'ExecuteSSISPackage' 'Filter' 'ForEach' 'GetMetadata' 'HDInsightHive' 'HDInsightMapReduce' 'HDInsightPig' 'HDInsightSpark' 'HDInsightStreaming' 'IfCondition' 'Lookup' 'SqlServerStoredProcedure' 'Until' 'Wait' 'WebActivity' (required)

ActivityDependency

Name	Description	Value
activity	Activity name.	string (required)
dependencyConditions	Match-Condition for the dependency.	String array containing any of: 'Completed' 'Failed' 'Skipped' 'Succeeded' (required)

ActivityPolicy

Name	Description	Value
retry	Maximum ordinary retry attempts. Default is 0. Type: integer (or Expression with resultType integer), minimum: 0.	any
retryIntervalInSeconds	Interval between each retry attempt (in seconds). The default is 30 sec.	int Constraints: Min value = 30 Max value = 86400
secureOutput	When set to true, Output from activity is considered as secure and will not be logged to monitoring.	bool
timeout	Specifies the timeout for the activity to run. The default timeout is 7 days. Type: string (or Expression with resultType string), pattern: ((\d+).)?(\d\d):(60	([0-5][0-9])):(60	([0-5][0-9])).	any

AzureKeyVaultSecretReference

Name	Description	Value
secretName	The name of the secret in Azure Key Vault. Type: string (or Expression with resultType string).	any (required)
secretVersion	The version of the secret in Azure Key Vault. The default value is the latest version of the secret. Type: string (or Expression with resultType string).	any
store	The Azure Key Vault linked service reference.	LinkedServiceReference (required)
type	Type of the secret.	'AzureKeyVaultSecret' (required)

AzureMLBatchExecutionActivity

Name	Description	Value
linkedServiceName	Linked service reference.	LinkedServiceReference
policy	Activity policy.	ActivityPolicy
type	Type of activity.	'AzureMLBatchExecution' (required)
typeProperties	Azure ML Batch Execution activity properties.	AzureMLBatchExecutionActivityTypeProperties (required)

AzureMLBatchExecutionActivityTypeProperties

Name	Description	Value
globalParameters	Key,Value pairs to be passed to the Azure ML Batch Execution Service endpoint. Keys must match the names of web service parameters defined in the published Azure ML web service. Values will be passed in the GlobalParameters property of the Azure ML batch execution request.	AzureMLBatchExecutionActivityTypePropertiesGlobalParameters
webServiceInputs	Key,Value pairs, mapping the names of Azure ML endpoint's Web Service Inputs to AzureMLWebServiceFile objects specifying the input Blob locations.. This information will be passed in the WebServiceInputs property of the Azure ML batch execution request.	AzureMLBatchExecutionActivityTypePropertiesWebServiceInputs
webServiceOutputs	Key,Value pairs, mapping the names of Azure ML endpoint's Web Service Outputs to AzureMLWebServiceFile objects specifying the output Blob locations. This information will be passed in the WebServiceOutputs property of the Azure ML batch execution request.	AzureMLBatchExecutionActivityTypePropertiesWebServiceOutputs

AzureMLBatchExecutionActivityTypePropertiesGlobalParameters

Name	Description	Value

AzureMLBatchExecutionActivityTypePropertiesWebServiceInputs

Name	Description	Value

AzureMLBatchExecutionActivityTypePropertiesWebServiceOutputs

Name	Description	Value

AzureMLUpdateResourceActivity

Name	Description	Value
linkedServiceName	Linked service reference.	LinkedServiceReference
policy	Activity policy.	ActivityPolicy
type	Type of activity.	'AzureMLUpdateResource' (required)
typeProperties	Azure ML Update Resource management activity properties.	AzureMLUpdateResourceActivityTypeProperties (required)

AzureMLUpdateResourceActivityTypeProperties

Name	Description	Value
trainedModelFilePath	The relative file path in trainedModelLinkedService to represent the .ilearner file that will be uploaded by the update operation. Type: string (or Expression with resultType string).	any (required)
trainedModelLinkedServiceName	Name of Azure Storage linked service holding the .ilearner file that will be uploaded by the update operation.	LinkedServiceReference (required)
trainedModelName	Name of the Trained Model module in the Web Service experiment to be updated. Type: string (or Expression with resultType string).	any (required)

AzureMLWebServiceFile

Name	Description	Value
filePath	The relative file path, including container name, in the Azure Blob Storage specified by the LinkedService. Type: string (or Expression with resultType string).	any (required)
linkedServiceName	Reference to an Azure Storage LinkedService, where Azure ML WebService Input/Output file located.	LinkedServiceReference (required)

CopyActivity

Name	Description	Value
inputs	List of inputs for the activity.	DatasetReference[]
linkedServiceName	Linked service reference.	LinkedServiceReference
outputs	List of outputs for the activity.	DatasetReference[]
policy	Activity policy.	ActivityPolicy
type	Type of activity.	'Copy' (required)
typeProperties	Copy activity properties.	CopyActivityTypeProperties (required)

CopyActivityTypeProperties

Name	Description	Value
cloudDataMovementUnits	Maximum number of cloud data movement units that can be used to perform this data movement. Type: integer (or Expression with resultType integer), minimum: 0.	any
enableSkipIncompatibleRow	Whether to skip incompatible row. Default value is false. Type: boolean (or Expression with resultType boolean).	any
enableStaging	Specifies whether to copy data via an interim staging. Default value is false. Type: boolean (or Expression with resultType boolean).	any
parallelCopies	Maximum number of concurrent sessions opened on the source or sink to avoid overloading the data store. Type: integer (or Expression with resultType integer), minimum: 0.	any
redirectIncompatibleRowSettings	Redirect incompatible row settings when EnableSkipIncompatibleRow is true.	RedirectIncompatibleRowSettings
sink	Copy activity sink.	CopySink (required)
source	Copy activity source.	CopySource (required)
stagingSettings	Specifies interim staging settings when EnableStaging is true.	StagingSettings
translator	Copy activity translator. If not specified, tabular translator is used.	any

CopySink

Name	Description	Value
sinkRetryCount	Sink retry count. Type: integer (or Expression with resultType integer).	any
sinkRetryWait	Sink retry wait. Type: string (or Expression with resultType string), pattern: ((\d+).)?(\d\d):(60	([0-5][0-9])):(60	([0-5][0-9])).	any
type		(required)
writeBatchSize	Write batch size. Type: integer (or Expression with resultType integer), minimum: 0.	any
writeBatchTimeout	Write batch timeout. Type: string (or Expression with resultType string), pattern: ((\d+).)?(\d\d):(60	([0-5][0-9])):(60	([0-5][0-9])).	any

CopySource

Name	Description	Value
sourceRetryCount	Source retry count. Type: integer (or Expression with resultType integer).	any
sourceRetryWait	Source retry wait. Type: string (or Expression with resultType string), pattern: ((\d+).)?(\d\d):(60	([0-5][0-9])):(60	([0-5][0-9])).	any
type		(required)

CustomActivity

Name	Description	Value
linkedServiceName	Linked service reference.	LinkedServiceReference
policy	Activity policy.	ActivityPolicy
type	Type of activity.	'Custom' (required)
typeProperties	Custom activity properties.	CustomActivityTypeProperties (required)

CustomActivityReferenceObject

Name	Description	Value
datasets	Dataset references.	DatasetReference[]
linkedServices	Linked service references.	LinkedServiceReference[]

CustomActivityTypeProperties

Name	Description	Value
command	Command for custom activity Type: string (or Expression with resultType string).	any (required)
extendedProperties	User defined property bag. There is no restriction on the keys or values that can be used. The user specified custom activity has the full responsibility to consume and interpret the content defined.	CustomActivityTypePropertiesExtendedProperties
folderPath	Folder path for resource files Type: string (or Expression with resultType string).	any
referenceObjects	Reference objects	CustomActivityReferenceObject
resourceLinkedService	Resource linked service reference.	LinkedServiceReference

CustomActivityTypePropertiesExtendedProperties

Name	Description	Value

DatabricksNotebookActivity

Name	Description	Value
linkedServiceName	Linked service reference.	LinkedServiceReference
policy	Activity policy.	ActivityPolicy
type	Type of activity.	'DatabricksNotebook' (required)
typeProperties	Databricks Notebook activity properties.	DatabricksNotebookActivityTypeProperties (required)

DatabricksNotebookActivityTypeProperties

Name	Description	Value
baseParameters	Base parameters to be used for each run of this job.If the notebook takes a parameter that is not specified, the default value from the notebook will be used.	DatabricksNotebookActivityTypePropertiesBaseParameters
notebookPath	The absolute path of the notebook to be run in the Databricks Workspace. This path must begin with a slash. Type: string (or Expression with resultType string).	any (required)

DatabricksNotebookActivityTypePropertiesBaseParameters

Name	Description	Value

DataLakeAnalyticsUsqlActivity

Name	Description	Value
linkedServiceName	Linked service reference.	LinkedServiceReference
policy	Activity policy.	ActivityPolicy
type	Type of activity.	'DataLakeAnalyticsU-SQL' (required)
typeProperties	Data Lake Analytics U-SQL activity properties.	DataLakeAnalyticsUsqlActivityTypeProperties (required)

DataLakeAnalyticsUsqlActivityTypeProperties

Name	Description	Value
compilationMode	Compilation mode of U-SQL. Must be one of these values : Semantic, Full and SingleBox. Type: string (or Expression with resultType string).	any
degreeOfParallelism	The maximum number of nodes simultaneously used to run the job. Default value is 1. Type: integer (or Expression with resultType integer), minimum: 1.	any
parameters	Parameters for U-SQL job request.	DataLakeAnalyticsUsqlActivityTypePropertiesParameters
priority	Determines which jobs out of all that are queued should be selected to run first. The lower the number, the higher the priority. Default value is 1000. Type: integer (or Expression with resultType integer), minimum: 1.	any
runtimeVersion	Runtime version of the U-SQL engine to use. Type: string (or Expression with resultType string).	any
scriptLinkedService	Script linked service reference.	LinkedServiceReference (required)
scriptPath	Case-sensitive path to folder that contains the U-SQL script. Type: string (or Expression with resultType string).	any (required)

DataLakeAnalyticsUsqlActivityTypePropertiesParameters

Name	Description	Value

DatasetReference

Name	Description	Value
parameters	Arguments for dataset.	ParameterValueSpecification
referenceName	Reference dataset name.	string (required)
type	Dataset reference type.	'DatasetReference' (required)

ExecutePipelineActivity

Name	Description	Value
type	Type of activity.	'ExecutePipeline' (required)
typeProperties	Execute pipeline activity properties.	ExecutePipelineActivityTypeProperties (required)

ExecutePipelineActivityTypeProperties

Name	Description	Value
parameters	Pipeline parameters.	ParameterValueSpecification
pipeline	Pipeline reference.	PipelineReference (required)
waitOnCompletion	Defines whether activity execution will wait for the dependent pipeline execution to finish. Default is false.	bool

ExecuteSsisPackageActivity

Name	Description	Value
linkedServiceName	Linked service reference.	LinkedServiceReference
policy	Activity policy.	ActivityPolicy
type	Type of activity.	'ExecuteSSISPackage' (required)
typeProperties	Execute SSIS package activity properties.	ExecuteSsisPackageActivityTypeProperties (required)

ExecuteSsisPackageActivityTypeProperties

Name	Description	Value
connectVia	The integration runtime reference.	IntegrationRuntimeReference (required)
environmentPath	The environment path to execute the SSIS package. Type: string (or Expression with resultType string).	any
executionCredential	The package execution credential.	SsisExecutionCredential
loggingLevel	The logging level of SSIS package execution. Type: string (or Expression with resultType string).	any
logLocation	SSIS package execution log location.	SsisLogLocation
packageConnectionManagers	The package level connection managers to execute the SSIS package.	ExecuteSsisPackageActivityTypePropertiesPackageConnectionManagers
packageLocation	SSIS package location.	SsisPackageLocation (required)
packageParameters	The package level parameters to execute the SSIS package.	ExecuteSsisPackageActivityTypePropertiesPackageParameters
projectConnectionManagers	The project level connection managers to execute the SSIS package.	ExecuteSsisPackageActivityTypePropertiesProjectConnectionManagers
projectParameters	The project level parameters to execute the SSIS package.	ExecuteSsisPackageActivityTypePropertiesProjectParameters
propertyOverrides	The property overrides to execute the SSIS package.	ExecuteSsisPackageActivityTypePropertiesPropertyOverrides
runtime	Specifies the runtime to execute SSIS package. The value should be "x86" or "x64". Type: string (or Expression with resultType string).	any

ExecuteSsisPackageActivityTypePropertiesPackageConnectionManagers

Name	Description	Value

ExecuteSsisPackageActivityTypePropertiesPackageParameters

Name	Description	Value

ExecuteSsisPackageActivityTypePropertiesProjectConnectionManagers

Name	Description	Value

ExecuteSsisPackageActivityTypePropertiesProjectParameters

Name	Description	Value

ExecuteSsisPackageActivityTypePropertiesPropertyOverrides

Name	Description	Value

Expression

Name	Description	Value
type	Expression type.	'Expression' (required)
value	Expression value.	string (required)

FilterActivity

Name	Description	Value
type	Type of activity.	'Filter' (required)
typeProperties	Filter activity properties.	FilterActivityTypeProperties (required)

FilterActivityTypeProperties

Name	Description	Value
condition	Condition to be used for filtering the input.	Expression (required)
items	Input array on which filter should be applied.	Expression (required)

ForEachActivity

Name	Description	Value
type	Type of activity.	'ForEach' (required)
typeProperties	ForEach activity properties.	ForEachActivityTypeProperties (required)

ForEachActivityTypeProperties

Name	Description	Value
activities	List of activities to execute .	Activity[] (required)
batchCount	Batch count to be used for controlling the number of parallel execution (when isSequential is set to false).	int Constraints: Max value = 50
isSequential	Should the loop be executed in sequence or in parallel (max 50)	bool
items	Collection to iterate.	Expression (required)

GetMetadataActivity

Name	Description	Value
linkedServiceName	Linked service reference.	LinkedServiceReference
policy	Activity policy.	ActivityPolicy
type	Type of activity.	'GetMetadata' (required)
typeProperties	GetMetadata activity properties.	GetMetadataActivityTypeProperties (required)

GetMetadataActivityTypeProperties

Name	Description	Value
dataset	GetMetadata activity dataset reference.	DatasetReference (required)
fieldList	Fields of metadata to get from dataset.	any[]

HDInsightHiveActivity

Name	Description	Value
linkedServiceName	Linked service reference.	LinkedServiceReference
policy	Activity policy.	ActivityPolicy
type	Type of activity.	'HDInsightHive' (required)
typeProperties	HDInsight Hive activity properties.	HDInsightHiveActivityTypeProperties (required)

HDInsightHiveActivityTypeProperties

Name	Description	Value
arguments	User specified arguments to HDInsightActivity.	any[]
defines	Allows user to specify defines for Hive job request.	HDInsightHiveActivityTypePropertiesDefines
getDebugInfo	Debug info option.	'Always' 'Failure' 'None'
scriptLinkedService	Script linked service reference.	LinkedServiceReference
scriptPath	Script path. Type: string (or Expression with resultType string).	any
storageLinkedServices	Storage linked service references.	LinkedServiceReference[]

HDInsightHiveActivityTypePropertiesDefines

Name	Description	Value

HDInsightMapReduceActivity

Name	Description	Value
linkedServiceName	Linked service reference.	LinkedServiceReference
policy	Activity policy.	ActivityPolicy
type	Type of activity.	'HDInsightMapReduce' (required)
typeProperties	HDInsight MapReduce activity properties.	HDInsightMapReduceActivityTypeProperties (required)

HDInsightMapReduceActivityTypeProperties

Name	Description	Value
arguments	User specified arguments to HDInsightActivity.	any[]
className	Class name. Type: string (or Expression with resultType string).	any (required)
defines	Allows user to specify defines for the MapReduce job request.	HDInsightMapReduceActivityTypePropertiesDefines
getDebugInfo	Debug info option.	'Always' 'Failure' 'None'
jarFilePath	Jar path. Type: string (or Expression with resultType string).	any (required)
jarLibs	Jar libs.	any[]
jarLinkedService	Jar linked service reference.	LinkedServiceReference
storageLinkedServices	Storage linked service references.	LinkedServiceReference[]

HDInsightMapReduceActivityTypePropertiesDefines

Name	Description	Value

HDInsightPigActivity

Name	Description	Value
linkedServiceName	Linked service reference.	LinkedServiceReference
policy	Activity policy.	ActivityPolicy
type	Type of activity.	'HDInsightPig' (required)
typeProperties	HDInsight Pig activity properties.	HDInsightPigActivityTypeProperties (required)

HDInsightPigActivityTypeProperties

Name	Description	Value
arguments	User specified arguments to HDInsightActivity.	any[]
defines	Allows user to specify defines for Pig job request.	HDInsightPigActivityTypePropertiesDefines
getDebugInfo	Debug info option.	'Always' 'Failure' 'None'
scriptLinkedService	Script linked service reference.	LinkedServiceReference
scriptPath	Script path. Type: string (or Expression with resultType string).	any
storageLinkedServices	Storage linked service references.	LinkedServiceReference[]

HDInsightPigActivityTypePropertiesDefines

Name	Description	Value

HDInsightSparkActivity

Name	Description	Value
linkedServiceName	Linked service reference.	LinkedServiceReference
policy	Activity policy.	ActivityPolicy
type	Type of activity.	'HDInsightSpark' (required)
typeProperties	HDInsight spark activity properties.	HDInsightSparkActivityTypeProperties (required)

HDInsightSparkActivityTypeProperties

Name	Description	Value
arguments	The user-specified arguments to HDInsightSparkActivity.	any[]
className	The application's Java/Spark main class.	string
entryFilePath	The relative path to the root folder of the code/package to be executed. Type: string (or Expression with resultType string).	any (required)
getDebugInfo	Debug info option.	'Always' 'Failure' 'None'
proxyUser	The user to impersonate that will execute the job. Type: string (or Expression with resultType string).	any
rootPath	The root path in 'sparkJobLinkedService' for all the job’s files. Type: string (or Expression with resultType string).	any (required)
sparkConfig	Spark configuration property.	HDInsightSparkActivityTypePropertiesSparkConfig
sparkJobLinkedService	The storage linked service for uploading the entry file and dependencies, and for receiving logs.	LinkedServiceReference

HDInsightSparkActivityTypePropertiesSparkConfig

Name	Description	Value

HDInsightStreamingActivity

Name	Description	Value
linkedServiceName	Linked service reference.	LinkedServiceReference
policy	Activity policy.	ActivityPolicy
type	Type of activity.	'HDInsightStreaming' (required)
typeProperties	HDInsight streaming activity properties.	HDInsightStreamingActivityTypeProperties (required)

HDInsightStreamingActivityTypeProperties

Name	Description	Value
arguments	User specified arguments to HDInsightActivity.	any[]
combiner	Combiner executable name. Type: string (or Expression with resultType string).	any
commandEnvironment	Command line environment values.	any[]
defines	Allows user to specify defines for streaming job request.	HDInsightStreamingActivityTypePropertiesDefines
fileLinkedService	Linked service reference where the files are located.	LinkedServiceReference
filePaths	Paths to streaming job files. Can be directories.	any[] (required)
getDebugInfo	Debug info option.	'Always' 'Failure' 'None'
input	Input blob path. Type: string (or Expression with resultType string).	any (required)
mapper	Mapper executable name. Type: string (or Expression with resultType string).	any (required)
output	Output blob path. Type: string (or Expression with resultType string).	any (required)
reducer	Reducer executable name. Type: string (or Expression with resultType string).	any (required)
storageLinkedServices	Storage linked service references.	LinkedServiceReference[]

HDInsightStreamingActivityTypePropertiesDefines

Name	Description	Value

IfConditionActivity

Name	Description	Value
type	Type of activity.	'IfCondition' (required)
typeProperties	IfCondition activity properties.	IfConditionActivityTypeProperties (required)

IfConditionActivityTypeProperties

Name	Description	Value
expression	An expression that would evaluate to Boolean. This is used to determine the block of activities (ifTrueActivities or ifFalseActivities) that will be executed.	Expression (required)
ifFalseActivities	List of activities to execute if expression is evaluated to false. This is an optional property and if not provided, the activity will exit without any action.	Activity[]
ifTrueActivities	List of activities to execute if expression is evaluated to true. This is an optional property and if not provided, the activity will exit without any action.	Activity[]

IntegrationRuntimeReference

Name	Description	Value
parameters	Arguments for integration runtime.	ParameterValueSpecification
referenceName	Reference integration runtime name.	string (required)
type	Type of integration runtime.	'IntegrationRuntimeReference' (required)

LinkedServiceReference

Name	Description	Value
parameters	Arguments for LinkedService.	ParameterValueSpecification
referenceName	Reference LinkedService name.	string (required)
type	Linked service reference type.	'LinkedServiceReference' (required)

LookupActivity

Name	Description	Value
linkedServiceName	Linked service reference.	LinkedServiceReference
policy	Activity policy.	ActivityPolicy
type	Type of activity.	'Lookup' (required)
typeProperties	Lookup activity properties.	LookupActivityTypeProperties (required)

LookupActivityTypeProperties

Name	Description	Value
dataset	Lookup activity dataset reference.	DatasetReference (required)
firstRowOnly	Whether to return first row or all rows. Default value is true. Type: boolean (or Expression with resultType boolean).	any
source	Dataset-specific source properties, same as copy activity source.	CopySource (required)

Microsoft.DataFactory/factories/pipelines

Name	Description	Value
name	The resource name	string Constraints: Min length = 1 Max length = 1 Pattern = ^[A-Za-z0-9_][^<>*#.%&:\\+?/]*$ (required)
parent	In Bicep, you can specify the parent resource for a child resource. You only need to add this property when the child resource is declared outside of the parent resource. For more information, see Child resource outside parent resource.	Symbolic name for resource of type: factories
properties	Properties of the pipeline.	Pipeline (required)

ParameterDefinitionSpecification

Name	Description	Value

ParameterSpecification

Name	Description	Value
defaultValue	Default value of parameter.	any
type	Parameter type.	'Array' 'Bool' 'Float' 'Int' 'Object' 'SecureString' 'String' (required)

ParameterValueSpecification

Name	Description	Value

ParameterValueSpecification

Name	Description	Value

ParameterValueSpecification

Name	Description	Value

ParameterValueSpecification

Name	Description	Value

Pipeline

Name	Description	Value
activities	List of activities in pipeline.	Activity[]
annotations	List of tags that can be used for describing the Pipeline.	any[]
concurrency	The max number of concurrent runs for the pipeline.	int Constraints: Min value = 1
description	The description of the pipeline.	string
parameters	List of parameters for pipeline.	ParameterDefinitionSpecification

PipelineReference

Name	Description	Value
name	Reference name.	string
referenceName	Reference pipeline name.	string (required)
type	Pipeline reference type.	'PipelineReference' (required)

RedirectIncompatibleRowSettings

Name	Description	Value
linkedServiceName	Name of the Azure Storage, Storage SAS, or Azure Data Lake Store linked service used for redirecting incompatible row. Must be specified if redirectIncompatibleRowSettings is specified. Type: string (or Expression with resultType string).	any (required)
path	The path for storing the redirect incompatible row data. Type: string (or Expression with resultType string).	any

SecretBase

Name	Description	Value
type	Set to 'AzureKeyVaultSecret' for type AzureKeyVaultSecretReference. Set to 'SecureString' for type SecureString.	'AzureKeyVaultSecret' 'SecureString' (required)

SecureString

Name	Description	Value
type	Type of the secret.	string (required)
value	Value of secure string.	string (required)

SecureString

Name	Description	Value
type	Type of the secret.	'SecureString' (required)
value	Value of secure string.	string (required)

SqlServerStoredProcedureActivity

Name	Description	Value
linkedServiceName	Linked service reference.	LinkedServiceReference
policy	Activity policy.	ActivityPolicy
type	Type of activity.	'SqlServerStoredProcedure' (required)
typeProperties	SQL stored procedure activity properties.	SqlServerStoredProcedureActivityTypeProperties (required)

SqlServerStoredProcedureActivityTypeProperties

Name	Description	Value
storedProcedureName	Stored procedure name. Type: string (or Expression with resultType string).	any (required)
storedProcedureParameters	Value and type setting for stored procedure parameters. Example: "{Parameter1: {value: "1", type: "int"}}".	SqlServerStoredProcedureActivityTypePropertiesStoredProcedureParameters

SqlServerStoredProcedureActivityTypePropertiesStoredProcedureParameters

Name	Description	Value

SsisAccessCredential

Name	Description	Value
domain	Domain for windows authentication.	any (required)
password	Password for windows authentication.	SecretBase (required)
userName	UseName for windows authentication.	any (required)

SsisConnectionManager

Name	Description	Value

SsisConnectionManager

Name	Description	Value

SsisExecutionCredential

Name	Description	Value
domain	Domain for windows authentication.	any (required)
password	Password for windows authentication.	SecureString (required)
userName	UseName for windows authentication.	any (required)

SsisExecutionParameter

Name	Description	Value
value	SSIS package execution parameter value. Type: string (or Expression with resultType string).	any (required)

SsisLogLocation

Name	Description	Value
logPath	The SSIS package execution log path. Type: string (or Expression with resultType string).	any (required)
type	The type of SSIS log location.	'File' (required)
typeProperties	SSIS package execution log location properties.	SsisLogLocationTypeProperties (required)

SsisLogLocationTypeProperties

Name	Description	Value
accessCredential	The package execution log access credential.	SsisAccessCredential
logRefreshInterval	Specifies the interval to refresh log. The default interval is 5 minutes. Type: string (or Expression with resultType string), pattern: ((\d+).)?(\d\d):(60	([0-5][0-9])):(60	([0-5][0-9])).	any

SsisPackageLocation

Name	Description	Value
packagePath	The SSIS package path. Type: string (or Expression with resultType string).	any (required)
type	The type of SSIS package location.	'File' 'SSISDB'
typeProperties	SSIS package location properties.	SsisPackageLocationTypeProperties

SsisPackageLocationTypeProperties

Name	Description	Value
accessCredential	The package access credential.	SsisAccessCredential
configurationPath	The configuration file of the package execution. Type: string (or Expression with resultType string).	any
packagePassword	Password of the package.	SecretBase

SsisPropertyOverride

Name	Description	Value
isSensitive	Whether SSIS package property override value is sensitive data. Value will be encrypted in SSISDB if it is true	bool
value	SSIS package property override value. Type: string (or Expression with resultType string).	any (required)

StagingSettings

Name	Description	Value
enableCompression	Specifies whether to use compression when copying data via an interim staging. Default value is false. Type: boolean (or Expression with resultType boolean).	any
linkedServiceName	Staging linked service reference.	LinkedServiceReference (required)
path	The path to storage for storing the interim data. Type: string (or Expression with resultType string).	any

StoredProcedureParameter

Name	Description	Value
type	Stored procedure parameter type.	'Boolean' 'Date' 'Decimal' 'Guid' 'Int' 'Int64' 'String'
value	Stored procedure parameter value. Type: string (or Expression with resultType string).	any (required)

UntilActivity

Name	Description	Value
type	Type of activity.	'Until' (required)
typeProperties	Until activity properties.	UntilActivityTypeProperties (required)

UntilActivityTypeProperties

Name	Description	Value
activities	List of activities to execute.	Activity[] (required)
expression	An expression that would evaluate to Boolean. The loop will continue until this expression evaluates to true	Expression (required)
timeout	Specifies the timeout for the activity to run. If there is no value specified, it takes the value of TimeSpan.FromDays(7) which is 1 week as default. Type: string (or Expression with resultType string), pattern: ((\d+).)?(\d\d):(60	([0-5][0-9])):(60	([0-5][0-9])). Type: string (or Expression with resultType string), pattern: ((\d+).)?(\d\d):(60	([0-5][0-9])):(60	([0-5][0-9])).	any

WaitActivity

Name	Description	Value
type	Type of activity.	'Wait' (required)
typeProperties	Wait activity properties.	WaitActivityTypeProperties (required)

WaitActivityTypeProperties

Name	Description	Value
waitTimeInSeconds	Duration in seconds.	int (required)

WebActivity

Name	Description	Value
linkedServiceName	Linked service reference.	LinkedServiceReference
policy	Activity policy.	ActivityPolicy
type	Type of activity.	'WebActivity' (required)
typeProperties	Web activity properties.	WebActivityTypeProperties (required)

WebActivityAuthentication

Name	Description	Value
password	Password for the PFX file or basic authentication.	SecureString
pfx	Base64-encoded contents of a PFX file.	SecureString
resource	Resource for which Azure Auth token will be requested when using MSI Authentication.	string
type	Web activity authentication (Basic/ClientCertificate/MSI)	string (required)
username	Web activity authentication user name for basic authentication.	string

WebActivityTypeProperties

Name	Description	Value
authentication	Authentication method used for calling the endpoint.	WebActivityAuthentication
body	Represents the payload that will be sent to the endpoint. Required for POST/PUT method, not allowed for GET method Type: string (or Expression with resultType string).	any
datasets	List of datasets passed to web endpoint.	DatasetReference[]
disableCertValidation	When set to true, Certificate validation will be disabled.	bool
headers	Represents the headers that will be sent to the request. For example, to set the language and type on a request: "headers" : { "Accept-Language": "en-us", "Content-Type": "application/json" }. Type: string (or Expression with resultType string).	any
linkedServices	List of linked services passed to web endpoint.	LinkedServiceReference[]
method	Rest API method for target endpoint.	'DELETE' 'GET' 'POST' 'PUT' (required)
url	Web activity target endpoint and path. Type: string (or Expression with resultType string).	any (required)

Quickstart samples

The following quickstart samples deploy this resource type.

Bicep File	Description
Create a V2 data factory	This template creates a V2 data factory that copies data from a folder in an Azure Blob Storage to another folder in the storage.
More is possible with Azure Data Factory - One click to try Azure Data Factory	This template creates a data factory pipeline for a copy activity from Azure Blob into another Azure Blob

ARM template resource definition

The factories/pipelines resource type can be deployed with operations that target:

• Resource groups - See resource group deployment commands

For a list of changed properties in each API version, see change log.

Resource format

To create a Microsoft.DataFactory/factories/pipelines resource, add the following JSON to your template.

{
  "type": "Microsoft.DataFactory/factories/pipelines",
  "apiVersion": "2017-09-01-preview",
  "name": "string",
  "properties": {
    "activities": [ {
      "dependsOn": [
        {
          "activity": "string",
          "dependencyConditions": [ "string" ]
        }
      ],
      "description": "string",
      "name": "string",
      "type": "string"
      // For remaining properties, see Activity objects
    } ],
    "annotations": [ {} ],
    "concurrency": "int",
    "description": "string",
    "parameters": {
      "{customized property}": {
        "defaultValue": {},
        "type": "string"
      }
    }
  }
}

CopySink objects

Set the type property to specify the type of object.

SecretBase objects

Set the type property to specify the type of object.

For AzureKeyVaultSecret, use:

{
  "secretName": {},
  "secretVersion": {},
  "store": {
    "parameters": {
      "{customized property}": {}
    },
    "referenceName": "string",
    "type": "string"
  },
  "type": "AzureKeyVaultSecret"
}

For SecureString, use:

{
  "type": "SecureString",
  "value": "string"
}

CopySource objects

Set the type property to specify the type of object.

Activity objects

Set the type property to specify the type of object.

For AzureMLBatchExecution, use:

{
  "linkedServiceName": {
    "parameters": {
      "{customized property}": {}
    },
    "referenceName": "string",
    "type": "string"
  },
  "policy": {
    "retry": {},
    "retryIntervalInSeconds": "int",
    "secureOutput": "bool",
    "timeout": {}
  },
  "type": "AzureMLBatchExecution",
  "typeProperties": {
    "globalParameters": {
      "{customized property}": {}
    },
    "webServiceInputs": {
      "{customized property}": {
        "filePath": {},
        "linkedServiceName": {
          "parameters": {
            "{customized property}": {}
          },
          "referenceName": "string",
          "type": "string"
        }
      }
    },
    "webServiceOutputs": {
      "{customized property}": {
        "filePath": {},
        "linkedServiceName": {
          "parameters": {
            "{customized property}": {}
          },
          "referenceName": "string",
          "type": "string"
        }
      }
    }
  }
}

For AzureMLUpdateResource, use:

{
  "linkedServiceName": {
    "parameters": {
      "{customized property}": {}
    },
    "referenceName": "string",
    "type": "string"
  },
  "policy": {
    "retry": {},
    "retryIntervalInSeconds": "int",
    "secureOutput": "bool",
    "timeout": {}
  },
  "type": "AzureMLUpdateResource",
  "typeProperties": {
    "trainedModelFilePath": {},
    "trainedModelLinkedServiceName": {
      "parameters": {
        "{customized property}": {}
      },
      "referenceName": "string",
      "type": "string"
    },
    "trainedModelName": {}
  }
}

For ExecutePipeline, use:

{
  "type": "ExecutePipeline",
  "typeProperties": {
    "parameters": {
      "{customized property}": {}
    },
    "pipeline": {
      "name": "string",
      "referenceName": "string",
      "type": "string"
    },
    "waitOnCompletion": "bool"
  }
}

For Filter, use:

{
  "type": "Filter",
  "typeProperties": {
    "condition": {
      "type": "string",
      "value": "string"
    },
    "items": {
      "type": "string",
      "value": "string"
    }
  }
}

For ForEach, use:

{
  "type": "ForEach",
  "typeProperties": {
    "activities": [ {
      "dependsOn": [
        {
          "activity": "string",
          "dependencyConditions": [ "string" ]
        }
      ],
      "description": "string",
      "name": "string",
      "type": "string"
      // For remaining properties, see Activity objects
    } ],
    "batchCount": "int",
    "isSequential": "bool",
    "items": {
      "type": "string",
      "value": "string"
    }
  }
}

For IfCondition, use:

{
  "type": "IfCondition",
  "typeProperties": {
    "expression": {
      "type": "string",
      "value": "string"
    },
    "ifFalseActivities": [ {
      "dependsOn": [
        {
          "activity": "string",
          "dependencyConditions": [ "string" ]
        }
      ],
      "description": "string",
      "name": "string",
      "type": "string"
      // For remaining properties, see Activity objects
    } ],
    "ifTrueActivities": [ {
      "dependsOn": [
        {
          "activity": "string",
          "dependencyConditions": [ "string" ]
        }
      ],
      "description": "string",
      "name": "string",
      "type": "string"
      // For remaining properties, see Activity objects
    } ]
  }
}

For Until, use:

{
  "type": "Until",
  "typeProperties": {
    "activities": [ {
      "dependsOn": [
        {
          "activity": "string",
          "dependencyConditions": [ "string" ]
        }
      ],
      "description": "string",
      "name": "string",
      "type": "string"
      // For remaining properties, see Activity objects
    } ],
    "expression": {
      "type": "string",
      "value": "string"
    },
    "timeout": {}
  }
}

For Wait, use:

{
  "type": "Wait",
  "typeProperties": {
    "waitTimeInSeconds": "int"
  }
}

For Copy, use:

{
  "inputs": [
    {
      "parameters": {
        "{customized property}": {}
      },
      "referenceName": "string",
      "type": "string"
    }
  ],
  "linkedServiceName": {
    "parameters": {
      "{customized property}": {}
    },
    "referenceName": "string",
    "type": "string"
  },
  "outputs": [
    {
      "parameters": {
        "{customized property}": {}
      },
      "referenceName": "string",
      "type": "string"
    }
  ],
  "policy": {
    "retry": {},
    "retryIntervalInSeconds": "int",
    "secureOutput": "bool",
    "timeout": {}
  },
  "type": "Copy",
  "typeProperties": {
    "cloudDataMovementUnits": {},
    "enableSkipIncompatibleRow": {},
    "enableStaging": {},
    "parallelCopies": {},
    "redirectIncompatibleRowSettings": {
      "linkedServiceName": {},
      "path": {}
    },
    "sink": {
      "sinkRetryCount": {},
      "sinkRetryWait": {},
      "writeBatchSize": {},
      "writeBatchTimeout": {},
      "type": "string"
      // For remaining properties, see CopySink objects
    },
    "source": {
      "sourceRetryCount": {},
      "sourceRetryWait": {},
      "type": "string"
      // For remaining properties, see CopySource objects
    },
    "stagingSettings": {
      "enableCompression": {},
      "linkedServiceName": {
        "parameters": {
          "{customized property}": {}
        },
        "referenceName": "string",
        "type": "string"
      },
      "path": {}
    },
    "translator": {}
  }
}

For Custom, use:

{
  "linkedServiceName": {
    "parameters": {
      "{customized property}": {}
    },
    "referenceName": "string",
    "type": "string"
  },
  "policy": {
    "retry": {},
    "retryIntervalInSeconds": "int",
    "secureOutput": "bool",
    "timeout": {}
  },
  "type": "Custom",
  "typeProperties": {
    "command": {},
    "extendedProperties": {
      "{customized property}": {}
    },
    "folderPath": {},
    "referenceObjects": {
      "datasets": [
        {
          "parameters": {
            "{customized property}": {}
          },
          "referenceName": "string",
          "type": "string"
        }
      ],
      "linkedServices": [
        {
          "parameters": {
            "{customized property}": {}
          },
          "referenceName": "string",
          "type": "string"
        }
      ]
    },
    "resourceLinkedService": {
      "parameters": {
        "{customized property}": {}
      },
      "referenceName": "string",
      "type": "string"
    }
  }
}

For DataLakeAnalyticsU-SQL, use:

{
  "linkedServiceName": {
    "parameters": {
      "{customized property}": {}
    },
    "referenceName": "string",
    "type": "string"
  },
  "policy": {
    "retry": {},
    "retryIntervalInSeconds": "int",
    "secureOutput": "bool",
    "timeout": {}
  },
  "type": "DataLakeAnalyticsU-SQL",
  "typeProperties": {
    "compilationMode": {},
    "degreeOfParallelism": {},
    "parameters": {
      "{customized property}": {}
    },
    "priority": {},
    "runtimeVersion": {},
    "scriptLinkedService": {
      "parameters": {
        "{customized property}": {}
      },
      "referenceName": "string",
      "type": "string"
    },
    "scriptPath": {}
  }
}

For DatabricksNotebook, use:

{
  "linkedServiceName": {
    "parameters": {
      "{customized property}": {}
    },
    "referenceName": "string",
    "type": "string"
  },
  "policy": {
    "retry": {},
    "retryIntervalInSeconds": "int",
    "secureOutput": "bool",
    "timeout": {}
  },
  "type": "DatabricksNotebook",
  "typeProperties": {
    "baseParameters": {
      "{customized property}": {}
    },
    "notebookPath": {}
  }
}

For ExecuteSSISPackage, use:

{
  "linkedServiceName": {
    "parameters": {
      "{customized property}": {}
    },
    "referenceName": "string",
    "type": "string"
  },
  "policy": {
    "retry": {},
    "retryIntervalInSeconds": "int",
    "secureOutput": "bool",
    "timeout": {}
  },
  "type": "ExecuteSSISPackage",
  "typeProperties": {
    "connectVia": {
      "parameters": {
        "{customized property}": {}
      },
      "referenceName": "string",
      "type": "string"
    },
    "environmentPath": {},
    "executionCredential": {
      "domain": {},
      "password": {
        "type": "string",
        "value": "string"
      },
      "userName": {}
    },
    "loggingLevel": {},
    "logLocation": {
      "logPath": {},
      "type": "string",
      "typeProperties": {
        "accessCredential": {
          "domain": {},
          "password": {
            "type": "string"
            // For remaining properties, see SecretBase objects
          },
          "userName": {}
        },
        "logRefreshInterval": {}
      }
    },
    "packageConnectionManagers": {
      "{customized property}": {
        "{customized property}": {
          "value": {}
        }
      }
    },
    "packageLocation": {
      "packagePath": {},
      "type": "string",
      "typeProperties": {
        "accessCredential": {
          "domain": {},
          "password": {
            "type": "string"
            // For remaining properties, see SecretBase objects
          },
          "userName": {}
        },
        "configurationPath": {},
        "packagePassword": {
          "type": "string"
          // For remaining properties, see SecretBase objects
        }
      }
    },
    "packageParameters": {
      "{customized property}": {
        "value": {}
      }
    },
    "projectConnectionManagers": {
      "{customized property}": {
        "{customized property}": {
          "value": {}
        }
      }
    },
    "projectParameters": {
      "{customized property}": {
        "value": {}
      }
    },
    "propertyOverrides": {
      "{customized property}": {
        "isSensitive": "bool",
        "value": {}
      }
    },
    "runtime": {}
  }
}

For GetMetadata, use:

{
  "linkedServiceName": {
    "parameters": {
      "{customized property}": {}
    },
    "referenceName": "string",
    "type": "string"
  },
  "policy": {
    "retry": {},
    "retryIntervalInSeconds": "int",
    "secureOutput": "bool",
    "timeout": {}
  },
  "type": "GetMetadata",
  "typeProperties": {
    "dataset": {
      "parameters": {
        "{customized property}": {}
      },
      "referenceName": "string",
      "type": "string"
    },
    "fieldList": [ {} ]
  }
}

For HDInsightHive, use:

{
  "linkedServiceName": {
    "parameters": {
      "{customized property}": {}
    },
    "referenceName": "string",
    "type": "string"
  },
  "policy": {
    "retry": {},
    "retryIntervalInSeconds": "int",
    "secureOutput": "bool",
    "timeout": {}
  },
  "type": "HDInsightHive",
  "typeProperties": {
    "arguments": [ {} ],
    "defines": {
      "{customized property}": {}
    },
    "getDebugInfo": "string",
    "scriptLinkedService": {
      "parameters": {
        "{customized property}": {}
      },
      "referenceName": "string",
      "type": "string"
    },
    "scriptPath": {},
    "storageLinkedServices": [
      {
        "parameters": {
          "{customized property}": {}
        },
        "referenceName": "string",
        "type": "string"
      }
    ]
  }
}

For HDInsightMapReduce, use:

{
  "linkedServiceName": {
    "parameters": {
      "{customized property}": {}
    },
    "referenceName": "string",
    "type": "string"
  },
  "policy": {
    "retry": {},
    "retryIntervalInSeconds": "int",
    "secureOutput": "bool",
    "timeout": {}
  },
  "type": "HDInsightMapReduce",
  "typeProperties": {
    "arguments": [ {} ],
    "className": {},
    "defines": {
      "{customized property}": {}
    },
    "getDebugInfo": "string",
    "jarFilePath": {},
    "jarLibs": [ {} ],
    "jarLinkedService": {
      "parameters": {
        "{customized property}": {}
      },
      "referenceName": "string",
      "type": "string"
    },
    "storageLinkedServices": [
      {
        "parameters": {
          "{customized property}": {}
        },
        "referenceName": "string",
        "type": "string"
      }
    ]
  }
}

For HDInsightPig, use:

{
  "linkedServiceName": {
    "parameters": {
      "{customized property}": {}
    },
    "referenceName": "string",
    "type": "string"
  },
  "policy": {
    "retry": {},
    "retryIntervalInSeconds": "int",
    "secureOutput": "bool",
    "timeout": {}
  },
  "type": "HDInsightPig",
  "typeProperties": {
    "arguments": [ {} ],
    "defines": {
      "{customized property}": {}
    },
    "getDebugInfo": "string",
    "scriptLinkedService": {
      "parameters": {
        "{customized property}": {}
      },
      "referenceName": "string",
      "type": "string"
    },
    "scriptPath": {},
    "storageLinkedServices": [
      {
        "parameters": {
          "{customized property}": {}
        },
        "referenceName": "string",
        "type": "string"
      }
    ]
  }
}

For HDInsightSpark, use:

{
  "linkedServiceName": {
    "parameters": {
      "{customized property}": {}
    },
    "referenceName": "string",
    "type": "string"
  },
  "policy": {
    "retry": {},
    "retryIntervalInSeconds": "int",
    "secureOutput": "bool",
    "timeout": {}
  },
  "type": "HDInsightSpark",
  "typeProperties": {
    "arguments": [ {} ],
    "className": "string",
    "entryFilePath": {},
    "getDebugInfo": "string",
    "proxyUser": {},
    "rootPath": {},
    "sparkConfig": {
      "{customized property}": {}
    },
    "sparkJobLinkedService": {
      "parameters": {
        "{customized property}": {}
      },
      "referenceName": "string",
      "type": "string"
    }
  }
}

For HDInsightStreaming, use:

{
  "linkedServiceName": {
    "parameters": {
      "{customized property}": {}
    },
    "referenceName": "string",
    "type": "string"
  },
  "policy": {
    "retry": {},
    "retryIntervalInSeconds": "int",
    "secureOutput": "bool",
    "timeout": {}
  },
  "type": "HDInsightStreaming",
  "typeProperties": {
    "arguments": [ {} ],
    "combiner": {},
    "commandEnvironment": [ {} ],
    "defines": {
      "{customized property}": {}
    },
    "fileLinkedService": {
      "parameters": {
        "{customized property}": {}
      },
      "referenceName": "string",
      "type": "string"
    },
    "filePaths": [ {} ],
    "getDebugInfo": "string",
    "input": {},
    "mapper": {},
    "output": {},
    "reducer": {},
    "storageLinkedServices": [
      {
        "parameters": {
          "{customized property}": {}
        },
        "referenceName": "string",
        "type": "string"
      }
    ]
  }
}

For Lookup, use:

{
  "linkedServiceName": {
    "parameters": {
      "{customized property}": {}
    },
    "referenceName": "string",
    "type": "string"
  },
  "policy": {
    "retry": {},
    "retryIntervalInSeconds": "int",
    "secureOutput": "bool",
    "timeout": {}
  },
  "type": "Lookup",
  "typeProperties": {
    "dataset": {
      "parameters": {
        "{customized property}": {}
      },
      "referenceName": "string",
      "type": "string"
    },
    "firstRowOnly": {},
    "source": {
      "sourceRetryCount": {},
      "sourceRetryWait": {},
      "type": "string"
      // For remaining properties, see CopySource objects
    }
  }
}

For SqlServerStoredProcedure, use:

{
  "linkedServiceName": {
    "parameters": {
      "{customized property}": {}
    },
    "referenceName": "string",
    "type": "string"
  },
  "policy": {
    "retry": {},
    "retryIntervalInSeconds": "int",
    "secureOutput": "bool",
    "timeout": {}
  },
  "type": "SqlServerStoredProcedure",
  "typeProperties": {
    "storedProcedureName": {},
    "storedProcedureParameters": {
      "{customized property}": {
        "type": "string",
        "value": {}
      }
    }
  }
}

For WebActivity, use:

{
  "linkedServiceName": {
    "parameters": {
      "{customized property}": {}
    },
    "referenceName": "string",
    "type": "string"
  },
  "policy": {
    "retry": {},
    "retryIntervalInSeconds": "int",
    "secureOutput": "bool",
    "timeout": {}
  },
  "type": "WebActivity",
  "typeProperties": {
    "authentication": {
      "password": {
        "type": "string",
        "value": "string"
      },
      "pfx": {
        "type": "string",
        "value": "string"
      },
      "resource": "string",
      "type": "string",
      "username": "string"
    },
    "body": {},
    "datasets": [
      {
        "parameters": {
          "{customized property}": {}
        },
        "referenceName": "string",
        "type": "string"
      }
    ],
    "disableCertValidation": "bool",
    "headers": {},
    "linkedServices": [
      {
        "parameters": {
          "{customized property}": {}
        },
        "referenceName": "string",
        "type": "string"
      }
    ],
    "method": "string",
    "url": {}
  }
}

Property values

Activity

Name	Description	Value
dependsOn	Activity depends on condition.	ActivityDependency[]
description	Activity description.	string
name	Activity name.	string (required)
type	Set to 'AzureMLBatchExecution' for type AzureMLBatchExecutionActivity. Set to 'AzureMLUpdateResource' for type AzureMLUpdateResourceActivity. Set to 'ExecutePipeline' for type ExecutePipelineActivity. Set to 'Filter' for type FilterActivity. Set to 'ForEach' for type ForEachActivity. Set to 'IfCondition' for type IfConditionActivity. Set to 'Until' for type UntilActivity. Set to 'Wait' for type WaitActivity. Set to 'Copy' for type CopyActivity. Set to 'Custom' for type CustomActivity. Set to 'DataLakeAnalyticsU-SQL' for type DataLakeAnalyticsUsqlActivity. Set to 'DatabricksNotebook' for type DatabricksNotebookActivity. Set to 'ExecuteSSISPackage' for type ExecuteSsisPackageActivity. Set to 'GetMetadata' for type GetMetadataActivity. Set to 'HDInsightHive' for type HDInsightHiveActivity. Set to 'HDInsightMapReduce' for type HDInsightMapReduceActivity. Set to 'HDInsightPig' for type HDInsightPigActivity. Set to 'HDInsightSpark' for type HDInsightSparkActivity. Set to 'HDInsightStreaming' for type HDInsightStreamingActivity. Set to 'Lookup' for type LookupActivity. Set to 'SqlServerStoredProcedure' for type SqlServerStoredProcedureActivity. Set to 'WebActivity' for type WebActivity.	'AzureMLBatchExecution' 'AzureMLUpdateResource' 'Copy' 'Custom' 'DatabricksNotebook' 'DataLakeAnalyticsU-SQL' 'ExecutePipeline' 'ExecuteSSISPackage' 'Filter' 'ForEach' 'GetMetadata' 'HDInsightHive' 'HDInsightMapReduce' 'HDInsightPig' 'HDInsightSpark' 'HDInsightStreaming' 'IfCondition' 'Lookup' 'SqlServerStoredProcedure' 'Until' 'Wait' 'WebActivity' (required)

ActivityDependency

Name	Description	Value
activity	Activity name.	string (required)
dependencyConditions	Match-Condition for the dependency.	String array containing any of: 'Completed' 'Failed' 'Skipped' 'Succeeded' (required)

ActivityPolicy

Name	Description	Value
retry	Maximum ordinary retry attempts. Default is 0. Type: integer (or Expression with resultType integer), minimum: 0.	any
retryIntervalInSeconds	Interval between each retry attempt (in seconds). The default is 30 sec.	int Constraints: Min value = 30 Max value = 86400
secureOutput	When set to true, Output from activity is considered as secure and will not be logged to monitoring.	bool
timeout	Specifies the timeout for the activity to run. The default timeout is 7 days. Type: string (or Expression with resultType string), pattern: ((\d+).)?(\d\d):(60	([0-5][0-9])):(60	([0-5][0-9])).	any

AzureKeyVaultSecretReference

Name	Description	Value
secretName	The name of the secret in Azure Key Vault. Type: string (or Expression with resultType string).	any (required)
secretVersion	The version of the secret in Azure Key Vault. The default value is the latest version of the secret. Type: string (or Expression with resultType string).	any
store	The Azure Key Vault linked service reference.	LinkedServiceReference (required)
type	Type of the secret.	'AzureKeyVaultSecret' (required)

AzureMLBatchExecutionActivity

Name	Description	Value
linkedServiceName	Linked service reference.	LinkedServiceReference
policy	Activity policy.	ActivityPolicy
type	Type of activity.	'AzureMLBatchExecution' (required)
typeProperties	Azure ML Batch Execution activity properties.	AzureMLBatchExecutionActivityTypeProperties (required)

AzureMLBatchExecutionActivityTypeProperties

Name	Description	Value
globalParameters	Key,Value pairs to be passed to the Azure ML Batch Execution Service endpoint. Keys must match the names of web service parameters defined in the published Azure ML web service. Values will be passed in the GlobalParameters property of the Azure ML batch execution request.	AzureMLBatchExecutionActivityTypePropertiesGlobalParameters
webServiceInputs	Key,Value pairs, mapping the names of Azure ML endpoint's Web Service Inputs to AzureMLWebServiceFile objects specifying the input Blob locations.. This information will be passed in the WebServiceInputs property of the Azure ML batch execution request.	AzureMLBatchExecutionActivityTypePropertiesWebServiceInputs
webServiceOutputs	Key,Value pairs, mapping the names of Azure ML endpoint's Web Service Outputs to AzureMLWebServiceFile objects specifying the output Blob locations. This information will be passed in the WebServiceOutputs property of the Azure ML batch execution request.	AzureMLBatchExecutionActivityTypePropertiesWebServiceOutputs

AzureMLBatchExecutionActivityTypePropertiesGlobalParameters

Name	Description	Value

AzureMLBatchExecutionActivityTypePropertiesWebServiceInputs

Name	Description	Value

AzureMLBatchExecutionActivityTypePropertiesWebServiceOutputs

Name	Description	Value

AzureMLUpdateResourceActivity

Name	Description	Value
linkedServiceName	Linked service reference.	LinkedServiceReference
policy	Activity policy.	ActivityPolicy
type	Type of activity.	'AzureMLUpdateResource' (required)
typeProperties	Azure ML Update Resource management activity properties.	AzureMLUpdateResourceActivityTypeProperties (required)

AzureMLUpdateResourceActivityTypeProperties

Name	Description	Value
trainedModelFilePath	The relative file path in trainedModelLinkedService to represent the .ilearner file that will be uploaded by the update operation. Type: string (or Expression with resultType string).	any (required)
trainedModelLinkedServiceName	Name of Azure Storage linked service holding the .ilearner file that will be uploaded by the update operation.	LinkedServiceReference (required)
trainedModelName	Name of the Trained Model module in the Web Service experiment to be updated. Type: string (or Expression with resultType string).	any (required)

AzureMLWebServiceFile

Name	Description	Value
filePath	The relative file path, including container name, in the Azure Blob Storage specified by the LinkedService. Type: string (or Expression with resultType string).	any (required)
linkedServiceName	Reference to an Azure Storage LinkedService, where Azure ML WebService Input/Output file located.	LinkedServiceReference (required)

CopyActivity

Name	Description	Value
inputs	List of inputs for the activity.	DatasetReference[]
linkedServiceName	Linked service reference.	LinkedServiceReference
outputs	List of outputs for the activity.	DatasetReference[]
policy	Activity policy.	ActivityPolicy
type	Type of activity.	'Copy' (required)
typeProperties	Copy activity properties.	CopyActivityTypeProperties (required)

CopyActivityTypeProperties

Name	Description	Value
cloudDataMovementUnits	Maximum number of cloud data movement units that can be used to perform this data movement. Type: integer (or Expression with resultType integer), minimum: 0.	any
enableSkipIncompatibleRow	Whether to skip incompatible row. Default value is false. Type: boolean (or Expression with resultType boolean).	any
enableStaging	Specifies whether to copy data via an interim staging. Default value is false. Type: boolean (or Expression with resultType boolean).	any
parallelCopies	Maximum number of concurrent sessions opened on the source or sink to avoid overloading the data store. Type: integer (or Expression with resultType integer), minimum: 0.	any
redirectIncompatibleRowSettings	Redirect incompatible row settings when EnableSkipIncompatibleRow is true.	RedirectIncompatibleRowSettings
sink	Copy activity sink.	CopySink (required)
source	Copy activity source.	CopySource (required)
stagingSettings	Specifies interim staging settings when EnableStaging is true.	StagingSettings
translator	Copy activity translator. If not specified, tabular translator is used.	any

CopySink

Name	Description	Value
sinkRetryCount	Sink retry count. Type: integer (or Expression with resultType integer).	any
sinkRetryWait	Sink retry wait. Type: string (or Expression with resultType string), pattern: ((\d+).)?(\d\d):(60	([0-5][0-9])):(60	([0-5][0-9])).	any
type		(required)
writeBatchSize	Write batch size. Type: integer (or Expression with resultType integer), minimum: 0.	any
writeBatchTimeout	Write batch timeout. Type: string (or Expression with resultType string), pattern: ((\d+).)?(\d\d):(60	([0-5][0-9])):(60	([0-5][0-9])).	any

CopySource

Name	Description	Value
sourceRetryCount	Source retry count. Type: integer (or Expression with resultType integer).	any
sourceRetryWait	Source retry wait. Type: string (or Expression with resultType string), pattern: ((\d+).)?(\d\d):(60	([0-5][0-9])):(60	([0-5][0-9])).	any
type		(required)

CustomActivity

Name	Description	Value
linkedServiceName	Linked service reference.	LinkedServiceReference
policy	Activity policy.	ActivityPolicy
type	Type of activity.	'Custom' (required)
typeProperties	Custom activity properties.	CustomActivityTypeProperties (required)

CustomActivityReferenceObject

Name	Description	Value
datasets	Dataset references.	DatasetReference[]
linkedServices	Linked service references.	LinkedServiceReference[]

CustomActivityTypeProperties

Name	Description	Value
command	Command for custom activity Type: string (or Expression with resultType string).	any (required)
extendedProperties	User defined property bag. There is no restriction on the keys or values that can be used. The user specified custom activity has the full responsibility to consume and interpret the content defined.	CustomActivityTypePropertiesExtendedProperties
folderPath	Folder path for resource files Type: string (or Expression with resultType string).	any
referenceObjects	Reference objects	CustomActivityReferenceObject
resourceLinkedService	Resource linked service reference.	LinkedServiceReference

CustomActivityTypePropertiesExtendedProperties

Name	Description	Value

DatabricksNotebookActivity

Name	Description	Value
linkedServiceName	Linked service reference.	LinkedServiceReference
policy	Activity policy.	ActivityPolicy
type	Type of activity.	'DatabricksNotebook' (required)
typeProperties	Databricks Notebook activity properties.	DatabricksNotebookActivityTypeProperties (required)

DatabricksNotebookActivityTypeProperties

Name	Description	Value
baseParameters	Base parameters to be used for each run of this job.If the notebook takes a parameter that is not specified, the default value from the notebook will be used.	DatabricksNotebookActivityTypePropertiesBaseParameters
notebookPath	The absolute path of the notebook to be run in the Databricks Workspace. This path must begin with a slash. Type: string (or Expression with resultType string).	any (required)

DatabricksNotebookActivityTypePropertiesBaseParameters

Name	Description	Value

DataLakeAnalyticsUsqlActivity

Name	Description	Value
linkedServiceName	Linked service reference.	LinkedServiceReference
policy	Activity policy.	ActivityPolicy
type	Type of activity.	'DataLakeAnalyticsU-SQL' (required)
typeProperties	Data Lake Analytics U-SQL activity properties.	DataLakeAnalyticsUsqlActivityTypeProperties (required)

DataLakeAnalyticsUsqlActivityTypeProperties

Name	Description	Value
compilationMode	Compilation mode of U-SQL. Must be one of these values : Semantic, Full and SingleBox. Type: string (or Expression with resultType string).	any
degreeOfParallelism	The maximum number of nodes simultaneously used to run the job. Default value is 1. Type: integer (or Expression with resultType integer), minimum: 1.	any
parameters	Parameters for U-SQL job request.	DataLakeAnalyticsUsqlActivityTypePropertiesParameters
priority	Determines which jobs out of all that are queued should be selected to run first. The lower the number, the higher the priority. Default value is 1000. Type: integer (or Expression with resultType integer), minimum: 1.	any
runtimeVersion	Runtime version of the U-SQL engine to use. Type: string (or Expression with resultType string).	any
scriptLinkedService	Script linked service reference.	LinkedServiceReference (required)
scriptPath	Case-sensitive path to folder that contains the U-SQL script. Type: string (or Expression with resultType string).	any (required)

DataLakeAnalyticsUsqlActivityTypePropertiesParameters

Name	Description	Value

DatasetReference

Name	Description	Value
parameters	Arguments for dataset.	ParameterValueSpecification
referenceName	Reference dataset name.	string (required)
type	Dataset reference type.	'DatasetReference' (required)

ExecutePipelineActivity

Name	Description	Value
type	Type of activity.	'ExecutePipeline' (required)
typeProperties	Execute pipeline activity properties.	ExecutePipelineActivityTypeProperties (required)

ExecutePipelineActivityTypeProperties

Name	Description	Value
parameters	Pipeline parameters.	ParameterValueSpecification
pipeline	Pipeline reference.	PipelineReference (required)
waitOnCompletion	Defines whether activity execution will wait for the dependent pipeline execution to finish. Default is false.	bool

ExecuteSsisPackageActivity

Name	Description	Value
linkedServiceName	Linked service reference.	LinkedServiceReference
policy	Activity policy.	ActivityPolicy
type	Type of activity.	'ExecuteSSISPackage' (required)
typeProperties	Execute SSIS package activity properties.	ExecuteSsisPackageActivityTypeProperties (required)

ExecuteSsisPackageActivityTypeProperties

Name	Description	Value
connectVia	The integration runtime reference.	IntegrationRuntimeReference (required)
environmentPath	The environment path to execute the SSIS package. Type: string (or Expression with resultType string).	any
executionCredential	The package execution credential.	SsisExecutionCredential
loggingLevel	The logging level of SSIS package execution. Type: string (or Expression with resultType string).	any
logLocation	SSIS package execution log location.	SsisLogLocation
packageConnectionManagers	The package level connection managers to execute the SSIS package.	ExecuteSsisPackageActivityTypePropertiesPackageConnectionManagers
packageLocation	SSIS package location.	SsisPackageLocation (required)
packageParameters	The package level parameters to execute the SSIS package.	ExecuteSsisPackageActivityTypePropertiesPackageParameters
projectConnectionManagers	The project level connection managers to execute the SSIS package.	ExecuteSsisPackageActivityTypePropertiesProjectConnectionManagers
projectParameters	The project level parameters to execute the SSIS package.	ExecuteSsisPackageActivityTypePropertiesProjectParameters
propertyOverrides	The property overrides to execute the SSIS package.	ExecuteSsisPackageActivityTypePropertiesPropertyOverrides
runtime	Specifies the runtime to execute SSIS package. The value should be "x86" or "x64". Type: string (or Expression with resultType string).	any

ExecuteSsisPackageActivityTypePropertiesPackageConnectionManagers

Name	Description	Value

ExecuteSsisPackageActivityTypePropertiesPackageParameters

Name	Description	Value

ExecuteSsisPackageActivityTypePropertiesProjectConnectionManagers

Name	Description	Value

ExecuteSsisPackageActivityTypePropertiesProjectParameters

Name	Description	Value

ExecuteSsisPackageActivityTypePropertiesPropertyOverrides

Name	Description	Value

Expression

Name	Description	Value
type	Expression type.	'Expression' (required)
value	Expression value.	string (required)

FilterActivity

Name	Description	Value
type	Type of activity.	'Filter' (required)
typeProperties	Filter activity properties.	FilterActivityTypeProperties (required)

FilterActivityTypeProperties

Name	Description	Value
condition	Condition to be used for filtering the input.	Expression (required)
items	Input array on which filter should be applied.	Expression (required)

ForEachActivity

Name	Description	Value
type	Type of activity.	'ForEach' (required)
typeProperties	ForEach activity properties.	ForEachActivityTypeProperties (required)

ForEachActivityTypeProperties

Name	Description	Value
activities	List of activities to execute .	Activity[] (required)
batchCount	Batch count to be used for controlling the number of parallel execution (when isSequential is set to false).	int Constraints: Max value = 50
isSequential	Should the loop be executed in sequence or in parallel (max 50)	bool
items	Collection to iterate.	Expression (required)

GetMetadataActivity

Name	Description	Value
linkedServiceName	Linked service reference.	LinkedServiceReference
policy	Activity policy.	ActivityPolicy
type	Type of activity.	'GetMetadata' (required)
typeProperties	GetMetadata activity properties.	GetMetadataActivityTypeProperties (required)

GetMetadataActivityTypeProperties

Name	Description	Value
dataset	GetMetadata activity dataset reference.	DatasetReference (required)
fieldList	Fields of metadata to get from dataset.	any[]

HDInsightHiveActivity

Name	Description	Value
linkedServiceName	Linked service reference.	LinkedServiceReference
policy	Activity policy.	ActivityPolicy
type	Type of activity.	'HDInsightHive' (required)
typeProperties	HDInsight Hive activity properties.	HDInsightHiveActivityTypeProperties (required)

HDInsightHiveActivityTypeProperties

Name	Description	Value
arguments	User specified arguments to HDInsightActivity.	any[]
defines	Allows user to specify defines for Hive job request.	HDInsightHiveActivityTypePropertiesDefines
getDebugInfo	Debug info option.	'Always' 'Failure' 'None'
scriptLinkedService	Script linked service reference.	LinkedServiceReference
scriptPath	Script path. Type: string (or Expression with resultType string).	any
storageLinkedServices	Storage linked service references.	LinkedServiceReference[]

HDInsightHiveActivityTypePropertiesDefines

Name	Description	Value

HDInsightMapReduceActivity

Name	Description	Value
linkedServiceName	Linked service reference.	LinkedServiceReference
policy	Activity policy.	ActivityPolicy
type	Type of activity.	'HDInsightMapReduce' (required)
typeProperties	HDInsight MapReduce activity properties.	HDInsightMapReduceActivityTypeProperties (required)

HDInsightMapReduceActivityTypeProperties

Name	Description	Value
arguments	User specified arguments to HDInsightActivity.	any[]
className	Class name. Type: string (or Expression with resultType string).	any (required)
defines	Allows user to specify defines for the MapReduce job request.	HDInsightMapReduceActivityTypePropertiesDefines
getDebugInfo	Debug info option.	'Always' 'Failure' 'None'
jarFilePath	Jar path. Type: string (or Expression with resultType string).	any (required)
jarLibs	Jar libs.	any[]
jarLinkedService	Jar linked service reference.	LinkedServiceReference
storageLinkedServices	Storage linked service references.	LinkedServiceReference[]

HDInsightMapReduceActivityTypePropertiesDefines

Name	Description	Value

HDInsightPigActivity

Name	Description	Value
linkedServiceName	Linked service reference.	LinkedServiceReference
policy	Activity policy.	ActivityPolicy
type	Type of activity.	'HDInsightPig' (required)
typeProperties	HDInsight Pig activity properties.	HDInsightPigActivityTypeProperties (required)

HDInsightPigActivityTypeProperties

Name	Description	Value
arguments	User specified arguments to HDInsightActivity.	any[]
defines	Allows user to specify defines for Pig job request.	HDInsightPigActivityTypePropertiesDefines
getDebugInfo	Debug info option.	'Always' 'Failure' 'None'
scriptLinkedService	Script linked service reference.	LinkedServiceReference
scriptPath	Script path. Type: string (or Expression with resultType string).	any
storageLinkedServices	Storage linked service references.	LinkedServiceReference[]

HDInsightPigActivityTypePropertiesDefines

Name	Description	Value

HDInsightSparkActivity

Name	Description	Value
linkedServiceName	Linked service reference.	LinkedServiceReference
policy	Activity policy.	ActivityPolicy
type	Type of activity.	'HDInsightSpark' (required)
typeProperties	HDInsight spark activity properties.	HDInsightSparkActivityTypeProperties (required)

HDInsightSparkActivityTypeProperties

Name	Description	Value
arguments	The user-specified arguments to HDInsightSparkActivity.	any[]
className	The application's Java/Spark main class.	string
entryFilePath	The relative path to the root folder of the code/package to be executed. Type: string (or Expression with resultType string).	any (required)
getDebugInfo	Debug info option.	'Always' 'Failure' 'None'
proxyUser	The user to impersonate that will execute the job. Type: string (or Expression with resultType string).	any
rootPath	The root path in 'sparkJobLinkedService' for all the job’s files. Type: string (or Expression with resultType string).	any (required)
sparkConfig	Spark configuration property.	HDInsightSparkActivityTypePropertiesSparkConfig
sparkJobLinkedService	The storage linked service for uploading the entry file and dependencies, and for receiving logs.	LinkedServiceReference

HDInsightSparkActivityTypePropertiesSparkConfig

Name	Description	Value

HDInsightStreamingActivity

Name	Description	Value
linkedServiceName	Linked service reference.	LinkedServiceReference
policy	Activity policy.	ActivityPolicy
type	Type of activity.	'HDInsightStreaming' (required)
typeProperties	HDInsight streaming activity properties.	HDInsightStreamingActivityTypeProperties (required)

HDInsightStreamingActivityTypeProperties

Name	Description	Value
arguments	User specified arguments to HDInsightActivity.	any[]
combiner	Combiner executable name. Type: string (or Expression with resultType string).	any
commandEnvironment	Command line environment values.	any[]
defines	Allows user to specify defines for streaming job request.	HDInsightStreamingActivityTypePropertiesDefines
fileLinkedService	Linked service reference where the files are located.	LinkedServiceReference
filePaths	Paths to streaming job files. Can be directories.	any[] (required)
getDebugInfo	Debug info option.	'Always' 'Failure' 'None'
input	Input blob path. Type: string (or Expression with resultType string).	any (required)
mapper	Mapper executable name. Type: string (or Expression with resultType string).	any (required)
output	Output blob path. Type: string (or Expression with resultType string).	any (required)
reducer	Reducer executable name. Type: string (or Expression with resultType string).	any (required)
storageLinkedServices	Storage linked service references.	LinkedServiceReference[]

HDInsightStreamingActivityTypePropertiesDefines

Name	Description	Value

IfConditionActivity

Name	Description	Value
type	Type of activity.	'IfCondition' (required)
typeProperties	IfCondition activity properties.	IfConditionActivityTypeProperties (required)

IfConditionActivityTypeProperties

Name	Description	Value
expression	An expression that would evaluate to Boolean. This is used to determine the block of activities (ifTrueActivities or ifFalseActivities) that will be executed.	Expression (required)
ifFalseActivities	List of activities to execute if expression is evaluated to false. This is an optional property and if not provided, the activity will exit without any action.	Activity[]
ifTrueActivities	List of activities to execute if expression is evaluated to true. This is an optional property and if not provided, the activity will exit without any action.	Activity[]

IntegrationRuntimeReference

Name	Description	Value
parameters	Arguments for integration runtime.	ParameterValueSpecification
referenceName	Reference integration runtime name.	string (required)
type	Type of integration runtime.	'IntegrationRuntimeReference' (required)

LinkedServiceReference

Name	Description	Value
parameters	Arguments for LinkedService.	ParameterValueSpecification
referenceName	Reference LinkedService name.	string (required)
type	Linked service reference type.	'LinkedServiceReference' (required)

LookupActivity

Name	Description	Value
linkedServiceName	Linked service reference.	LinkedServiceReference
policy	Activity policy.	ActivityPolicy
type	Type of activity.	'Lookup' (required)
typeProperties	Lookup activity properties.	LookupActivityTypeProperties (required)

LookupActivityTypeProperties

Name	Description	Value
dataset	Lookup activity dataset reference.	DatasetReference (required)
firstRowOnly	Whether to return first row or all rows. Default value is true. Type: boolean (or Expression with resultType boolean).	any
source	Dataset-specific source properties, same as copy activity source.	CopySource (required)

Microsoft.DataFactory/factories/pipelines

Name	Description	Value
apiVersion	The api version	'2017-09-01-preview'
name	The resource name	string Constraints: Min length = 1 Max length = 1 Pattern = ^[A-Za-z0-9_][^<>*#.%&:\\+?/]*$ (required)
properties	Properties of the pipeline.	Pipeline (required)
type	The resource type	'Microsoft.DataFactory/factories/pipelines'

ParameterDefinitionSpecification

Name	Description	Value

ParameterSpecification

Name	Description	Value
defaultValue	Default value of parameter.	any
type	Parameter type.	'Array' 'Bool' 'Float' 'Int' 'Object' 'SecureString' 'String' (required)

ParameterValueSpecification

Name	Description	Value

ParameterValueSpecification

Name	Description	Value

ParameterValueSpecification

Name	Description	Value

ParameterValueSpecification

Name	Description	Value

Pipeline

Name	Description	Value
activities	List of activities in pipeline.	Activity[]
annotations	List of tags that can be used for describing the Pipeline.	any[]
concurrency	The max number of concurrent runs for the pipeline.	int Constraints: Min value = 1
description	The description of the pipeline.	string
parameters	List of parameters for pipeline.	ParameterDefinitionSpecification

PipelineReference

Name	Description	Value
name	Reference name.	string
referenceName	Reference pipeline name.	string (required)
type	Pipeline reference type.	'PipelineReference' (required)

RedirectIncompatibleRowSettings

Name	Description	Value
linkedServiceName	Name of the Azure Storage, Storage SAS, or Azure Data Lake Store linked service used for redirecting incompatible row. Must be specified if redirectIncompatibleRowSettings is specified. Type: string (or Expression with resultType string).	any (required)
path	The path for storing the redirect incompatible row data. Type: string (or Expression with resultType string).	any

SecretBase

Name	Description	Value
type	Set to 'AzureKeyVaultSecret' for type AzureKeyVaultSecretReference. Set to 'SecureString' for type SecureString.	'AzureKeyVaultSecret' 'SecureString' (required)

SecureString

Name	Description	Value
type	Type of the secret.	string (required)
value	Value of secure string.	string (required)

SecureString

Name	Description	Value
type	Type of the secret.	'SecureString' (required)
value	Value of secure string.	string (required)

SqlServerStoredProcedureActivity

Name	Description	Value
linkedServiceName	Linked service reference.	LinkedServiceReference
policy	Activity policy.	ActivityPolicy
type	Type of activity.	'SqlServerStoredProcedure' (required)
typeProperties	SQL stored procedure activity properties.	SqlServerStoredProcedureActivityTypeProperties (required)

SqlServerStoredProcedureActivityTypeProperties

Name	Description	Value
storedProcedureName	Stored procedure name. Type: string (or Expression with resultType string).	any (required)
storedProcedureParameters	Value and type setting for stored procedure parameters. Example: "{Parameter1: {value: "1", type: "int"}}".	SqlServerStoredProcedureActivityTypePropertiesStoredProcedureParameters

SqlServerStoredProcedureActivityTypePropertiesStoredProcedureParameters

Name	Description	Value

SsisAccessCredential

Name	Description	Value
domain	Domain for windows authentication.	any (required)
password	Password for windows authentication.	SecretBase (required)
userName	UseName for windows authentication.	any (required)

SsisConnectionManager

Name	Description	Value

SsisConnectionManager

Name	Description	Value

SsisExecutionCredential

Name	Description	Value
domain	Domain for windows authentication.	any (required)
password	Password for windows authentication.	SecureString (required)
userName	UseName for windows authentication.	any (required)

SsisExecutionParameter

Name	Description	Value
value	SSIS package execution parameter value. Type: string (or Expression with resultType string).	any (required)

SsisLogLocation

Name	Description	Value
logPath	The SSIS package execution log path. Type: string (or Expression with resultType string).	any (required)
type	The type of SSIS log location.	'File' (required)
typeProperties	SSIS package execution log location properties.	SsisLogLocationTypeProperties (required)

SsisLogLocationTypeProperties

Name	Description	Value
accessCredential	The package execution log access credential.	SsisAccessCredential
logRefreshInterval	Specifies the interval to refresh log. The default interval is 5 minutes. Type: string (or Expression with resultType string), pattern: ((\d+).)?(\d\d):(60	([0-5][0-9])):(60	([0-5][0-9])).	any

SsisPackageLocation

Name	Description	Value
packagePath	The SSIS package path. Type: string (or Expression with resultType string).	any (required)
type	The type of SSIS package location.	'File' 'SSISDB'
typeProperties	SSIS package location properties.	SsisPackageLocationTypeProperties

SsisPackageLocationTypeProperties

Name	Description	Value
accessCredential	The package access credential.	SsisAccessCredential
configurationPath	The configuration file of the package execution. Type: string (or Expression with resultType string).	any
packagePassword	Password of the package.	SecretBase

SsisPropertyOverride

Name	Description	Value
isSensitive	Whether SSIS package property override value is sensitive data. Value will be encrypted in SSISDB if it is true	bool
value	SSIS package property override value. Type: string (or Expression with resultType string).	any (required)

StagingSettings

Name	Description	Value
enableCompression	Specifies whether to use compression when copying data via an interim staging. Default value is false. Type: boolean (or Expression with resultType boolean).	any
linkedServiceName	Staging linked service reference.	LinkedServiceReference (required)
path	The path to storage for storing the interim data. Type: string (or Expression with resultType string).	any

StoredProcedureParameter

Name	Description	Value
type	Stored procedure parameter type.	'Boolean' 'Date' 'Decimal' 'Guid' 'Int' 'Int64' 'String'
value	Stored procedure parameter value. Type: string (or Expression with resultType string).	any (required)

UntilActivity

Name	Description	Value
type	Type of activity.	'Until' (required)
typeProperties	Until activity properties.	UntilActivityTypeProperties (required)

UntilActivityTypeProperties

Name	Description	Value
activities	List of activities to execute.	Activity[] (required)
expression	An expression that would evaluate to Boolean. The loop will continue until this expression evaluates to true	Expression (required)
timeout	Specifies the timeout for the activity to run. If there is no value specified, it takes the value of TimeSpan.FromDays(7) which is 1 week as default. Type: string (or Expression with resultType string), pattern: ((\d+).)?(\d\d):(60	([0-5][0-9])):(60	([0-5][0-9])). Type: string (or Expression with resultType string), pattern: ((\d+).)?(\d\d):(60	([0-5][0-9])):(60	([0-5][0-9])).	any

WaitActivity

Name	Description	Value
type	Type of activity.	'Wait' (required)
typeProperties	Wait activity properties.	WaitActivityTypeProperties (required)

WaitActivityTypeProperties

Name	Description	Value
waitTimeInSeconds	Duration in seconds.	int (required)

WebActivity

Name	Description	Value
linkedServiceName	Linked service reference.	LinkedServiceReference
policy	Activity policy.	ActivityPolicy
type	Type of activity.	'WebActivity' (required)
typeProperties	Web activity properties.	WebActivityTypeProperties (required)

WebActivityAuthentication

Name	Description	Value
password	Password for the PFX file or basic authentication.	SecureString
pfx	Base64-encoded contents of a PFX file.	SecureString
resource	Resource for which Azure Auth token will be requested when using MSI Authentication.	string
type	Web activity authentication (Basic/ClientCertificate/MSI)	string (required)
username	Web activity authentication user name for basic authentication.	string

WebActivityTypeProperties

Name	Description	Value
authentication	Authentication method used for calling the endpoint.	WebActivityAuthentication
body	Represents the payload that will be sent to the endpoint. Required for POST/PUT method, not allowed for GET method Type: string (or Expression with resultType string).	any
datasets	List of datasets passed to web endpoint.	DatasetReference[]
disableCertValidation	When set to true, Certificate validation will be disabled.	bool
headers	Represents the headers that will be sent to the request. For example, to set the language and type on a request: "headers" : { "Accept-Language": "en-us", "Content-Type": "application/json" }. Type: string (or Expression with resultType string).	any
linkedServices	List of linked services passed to web endpoint.	LinkedServiceReference[]
method	Rest API method for target endpoint.	'DELETE' 'GET' 'POST' 'PUT' (required)
url	Web activity target endpoint and path. Type: string (or Expression with resultType string).	any (required)

Quickstart templates

The following quickstart templates deploy this resource type.

Template	Description
Create a V2 data factory	This template creates a V2 data factory that copies data from a folder in an Azure Blob Storage to another folder in the storage.
More is possible with Azure Data Factory - One click to try Azure Data Factory	This template creates a data factory pipeline for a copy activity from Azure Blob into another Azure Blob

Terraform (AzAPI provider) resource definition

The factories/pipelines resource type can be deployed with operations that target:

• Resource groups

For a list of changed properties in each API version, see change log.

Resource format

To create a Microsoft.DataFactory/factories/pipelines resource, add the following Terraform to your template.

resource "azapi_resource" "symbolicname" {
  type = "Microsoft.DataFactory/factories/pipelines@2017-09-01-preview"
  name = "string"
  body = jsonencode({
    properties = {
      activities = [
        {
          dependsOn = [
            {
              activity = "string"
              dependencyConditions = [
                "string"
              ]
            }
          ]
          description = "string"
          name = "string"
          type = "string"
          // For remaining properties, see Activity objects
        }
      ]
      annotations = [
        ?
      ]
      concurrency = int
      description = "string"
      parameters = {
        {customized property} = {
          defaultValue = ?
          type = "string"
        }
      }
    }
  })
}

CopySink objects

Set the type property to specify the type of object.

SecretBase objects

Set the type property to specify the type of object.

For AzureKeyVaultSecret, use:

{
  secretName = ?
  secretVersion = ?
  store = {
    parameters = {
      {customized property} = ?
    }
    referenceName = "string"
    type = "string"
  }
  type = "AzureKeyVaultSecret"
}

For SecureString, use:

{
  type = "SecureString"
  value = "string"
}

CopySource objects

Set the type property to specify the type of object.

Activity objects

Set the type property to specify the type of object.

For AzureMLBatchExecution, use:

{
  linkedServiceName = {
    parameters = {
      {customized property} = ?
    }
    referenceName = "string"
    type = "string"
  }
  policy = {
    retry = ?
    retryIntervalInSeconds = int
    secureOutput = bool
    timeout = ?
  }
  type = "AzureMLBatchExecution"
  typeProperties = {
    globalParameters = {
      {customized property} = ?
    }
    webServiceInputs = {
      {customized property} = {
        filePath = ?
        linkedServiceName = {
          parameters = {
            {customized property} = ?
          }
          referenceName = "string"
          type = "string"
        }
      }
    }
    webServiceOutputs = {
      {customized property} = {
        filePath = ?
        linkedServiceName = {
          parameters = {
            {customized property} = ?
          }
          referenceName = "string"
          type = "string"
        }
      }
    }
  }
}

For AzureMLUpdateResource, use:

{
  linkedServiceName = {
    parameters = {
      {customized property} = ?
    }
    referenceName = "string"
    type = "string"
  }
  policy = {
    retry = ?
    retryIntervalInSeconds = int
    secureOutput = bool
    timeout = ?
  }
  type = "AzureMLUpdateResource"
  typeProperties = {
    trainedModelFilePath = ?
    trainedModelLinkedServiceName = {
      parameters = {
        {customized property} = ?
      }
      referenceName = "string"
      type = "string"
    }
    trainedModelName = ?
  }
}

For ExecutePipeline, use:

{
  type = "ExecutePipeline"
  typeProperties = {
    parameters = {
      {customized property} = ?
    }
    pipeline = {
      name = "string"
      referenceName = "string"
      type = "string"
    }
    waitOnCompletion = bool
  }
}

For Filter, use:

{
  type = "Filter"
  typeProperties = {
    condition = {
      type = "string"
      value = "string"
    }
    items = {
      type = "string"
      value = "string"
    }
  }
}

For ForEach, use:

{
  type = "ForEach"
  typeProperties = {
    activities = [
      {
        dependsOn = [
          {
            activity = "string"
            dependencyConditions = [
              "string"
            ]
          }
        ]
        description = "string"
        name = "string"
        type = "string"
        // For remaining properties, see Activity objects
      }
    ]
    batchCount = int
    isSequential = bool
    items = {
      type = "string"
      value = "string"
    }
  }
}

For IfCondition, use:

{
  type = "IfCondition"
  typeProperties = {
    expression = {
      type = "string"
      value = "string"
    }
    ifFalseActivities = [
      {
        dependsOn = [
          {
            activity = "string"
            dependencyConditions = [
              "string"
            ]
          }
        ]
        description = "string"
        name = "string"
        type = "string"
        // For remaining properties, see Activity objects
      }
    ]
    ifTrueActivities = [
      {
        dependsOn = [
          {
            activity = "string"
            dependencyConditions = [
              "string"
            ]
          }
        ]
        description = "string"
        name = "string"
        type = "string"
        // For remaining properties, see Activity objects
      }
    ]
  }
}

For Until, use:

{
  type = "Until"
  typeProperties = {
    activities = [
      {
        dependsOn = [
          {
            activity = "string"
            dependencyConditions = [
              "string"
            ]
          }
        ]
        description = "string"
        name = "string"
        type = "string"
        // For remaining properties, see Activity objects
      }
    ]
    expression = {
      type = "string"
      value = "string"
    }
    timeout = ?
  }
}

For Wait, use:

{
  type = "Wait"
  typeProperties = {
    waitTimeInSeconds = int
  }
}

For Copy, use:

{
  inputs = [
    {
      parameters = {
        {customized property} = ?
      }
      referenceName = "string"
      type = "string"
    }
  ]
  linkedServiceName = {
    parameters = {
      {customized property} = ?
    }
    referenceName = "string"
    type = "string"
  }
  outputs = [
    {
      parameters = {
        {customized property} = ?
      }
      referenceName = "string"
      type = "string"
    }
  ]
  policy = {
    retry = ?
    retryIntervalInSeconds = int
    secureOutput = bool
    timeout = ?
  }
  type = "Copy"
  typeProperties = {
    cloudDataMovementUnits = ?
    enableSkipIncompatibleRow = ?
    enableStaging = ?
    parallelCopies = ?
    redirectIncompatibleRowSettings = {
      linkedServiceName = ?
      path = ?
    }
    sink = {
      sinkRetryCount = ?
      sinkRetryWait = ?
      writeBatchSize = ?
      writeBatchTimeout = ?
      type = "string"
      // For remaining properties, see CopySink objects
    }
    source = {
      sourceRetryCount = ?
      sourceRetryWait = ?
      type = "string"
      // For remaining properties, see CopySource objects
    }
    stagingSettings = {
      enableCompression = ?
      linkedServiceName = {
        parameters = {
          {customized property} = ?
        }
        referenceName = "string"
        type = "string"
      }
      path = ?
    }
    translator = ?
  }
}

For Custom, use:

{
  linkedServiceName = {
    parameters = {
      {customized property} = ?
    }
    referenceName = "string"
    type = "string"
  }
  policy = {
    retry = ?
    retryIntervalInSeconds = int
    secureOutput = bool
    timeout = ?
  }
  type = "Custom"
  typeProperties = {
    command = ?
    extendedProperties = {
      {customized property} = ?
    }
    folderPath = ?
    referenceObjects = {
      datasets = [
        {
          parameters = {
            {customized property} = ?
          }
          referenceName = "string"
          type = "string"
        }
      ]
      linkedServices = [
        {
          parameters = {
            {customized property} = ?
          }
          referenceName = "string"
          type = "string"
        }
      ]
    }
    resourceLinkedService = {
      parameters = {
        {customized property} = ?
      }
      referenceName = "string"
      type = "string"
    }
  }
}

For DataLakeAnalyticsU-SQL, use:

{
  linkedServiceName = {
    parameters = {
      {customized property} = ?
    }
    referenceName = "string"
    type = "string"
  }
  policy = {
    retry = ?
    retryIntervalInSeconds = int
    secureOutput = bool
    timeout = ?
  }
  type = "DataLakeAnalyticsU-SQL"
  typeProperties = {
    compilationMode = ?
    degreeOfParallelism = ?
    parameters = {
      {customized property} = ?
    }
    priority = ?
    runtimeVersion = ?
    scriptLinkedService = {
      parameters = {
        {customized property} = ?
      }
      referenceName = "string"
      type = "string"
    }
    scriptPath = ?
  }
}

For DatabricksNotebook, use:

{
  linkedServiceName = {
    parameters = {
      {customized property} = ?
    }
    referenceName = "string"
    type = "string"
  }
  policy = {
    retry = ?
    retryIntervalInSeconds = int
    secureOutput = bool
    timeout = ?
  }
  type = "DatabricksNotebook"
  typeProperties = {
    baseParameters = {
      {customized property} = ?
    }
    notebookPath = ?
  }
}

For ExecuteSSISPackage, use:

{
  linkedServiceName = {
    parameters = {
      {customized property} = ?
    }
    referenceName = "string"
    type = "string"
  }
  policy = {
    retry = ?
    retryIntervalInSeconds = int
    secureOutput = bool
    timeout = ?
  }
  type = "ExecuteSSISPackage"
  typeProperties = {
    connectVia = {
      parameters = {
        {customized property} = ?
      }
      referenceName = "string"
      type = "string"
    }
    environmentPath = ?
    executionCredential = {
      domain = ?
      password = {
        type = "string"
        value = "string"
      }
      userName = ?
    }
    loggingLevel = ?
    logLocation = {
      logPath = ?
      type = "string"
      typeProperties = {
        accessCredential = {
          domain = ?
          password = {
            type = "string"
            // For remaining properties, see SecretBase objects
          }
          userName = ?
        }
        logRefreshInterval = ?
      }
    }
    packageConnectionManagers = {
      {customized property} = {
        {customized property} = {
          value = ?
        }
      }
    }
    packageLocation = {
      packagePath = ?
      type = "string"
      typeProperties = {
        accessCredential = {
          domain = ?
          password = {
            type = "string"
            // For remaining properties, see SecretBase objects
          }
          userName = ?
        }
        configurationPath = ?
        packagePassword = {
          type = "string"
          // For remaining properties, see SecretBase objects
        }
      }
    }
    packageParameters = {
      {customized property} = {
        value = ?
      }
    }
    projectConnectionManagers = {
      {customized property} = {
        {customized property} = {
          value = ?
        }
      }
    }
    projectParameters = {
      {customized property} = {
        value = ?
      }
    }
    propertyOverrides = {
      {customized property} = {
        isSensitive = bool
        value = ?
      }
    }
    runtime = ?
  }
}

For GetMetadata, use:

{
  linkedServiceName = {
    parameters = {
      {customized property} = ?
    }
    referenceName = "string"
    type = "string"
  }
  policy = {
    retry = ?
    retryIntervalInSeconds = int
    secureOutput = bool
    timeout = ?
  }
  type = "GetMetadata"
  typeProperties = {
    dataset = {
      parameters = {
        {customized property} = ?
      }
      referenceName = "string"
      type = "string"
    }
    fieldList = [
      ?
    ]
  }
}

For HDInsightHive, use:

{
  linkedServiceName = {
    parameters = {
      {customized property} = ?
    }
    referenceName = "string"
    type = "string"
  }
  policy = {
    retry = ?
    retryIntervalInSeconds = int
    secureOutput = bool
    timeout = ?
  }
  type = "HDInsightHive"
  typeProperties = {
    arguments = [
      ?
    ]
    defines = {
      {customized property} = ?
    }
    getDebugInfo = "string"
    scriptLinkedService = {
      parameters = {
        {customized property} = ?
      }
      referenceName = "string"
      type = "string"
    }
    scriptPath = ?
    storageLinkedServices = [
      {
        parameters = {
          {customized property} = ?
        }
        referenceName = "string"
        type = "string"
      }
    ]
  }
}

For HDInsightMapReduce, use:

{
  linkedServiceName = {
    parameters = {
      {customized property} = ?
    }
    referenceName = "string"
    type = "string"
  }
  policy = {
    retry = ?
    retryIntervalInSeconds = int
    secureOutput = bool
    timeout = ?
  }
  type = "HDInsightMapReduce"
  typeProperties = {
    arguments = [
      ?
    ]
    className = ?
    defines = {
      {customized property} = ?
    }
    getDebugInfo = "string"
    jarFilePath = ?
    jarLibs = [
      ?
    ]
    jarLinkedService = {
      parameters = {
        {customized property} = ?
      }
      referenceName = "string"
      type = "string"
    }
    storageLinkedServices = [
      {
        parameters = {
          {customized property} = ?
        }
        referenceName = "string"
        type = "string"
      }
    ]
  }
}

For HDInsightPig, use:

{
  linkedServiceName = {
    parameters = {
      {customized property} = ?
    }
    referenceName = "string"
    type = "string"
  }
  policy = {
    retry = ?
    retryIntervalInSeconds = int
    secureOutput = bool
    timeout = ?
  }
  type = "HDInsightPig"
  typeProperties = {
    arguments = [
      ?
    ]
    defines = {
      {customized property} = ?
    }
    getDebugInfo = "string"
    scriptLinkedService = {
      parameters = {
        {customized property} = ?
      }
      referenceName = "string"
      type = "string"
    }
    scriptPath = ?
    storageLinkedServices = [
      {
        parameters = {
          {customized property} = ?
        }
        referenceName = "string"
        type = "string"
      }
    ]
  }
}

For HDInsightSpark, use:

{
  linkedServiceName = {
    parameters = {
      {customized property} = ?
    }
    referenceName = "string"
    type = "string"
  }
  policy = {
    retry = ?
    retryIntervalInSeconds = int
    secureOutput = bool
    timeout = ?
  }
  type = "HDInsightSpark"
  typeProperties = {
    arguments = [
      ?
    ]
    className = "string"
    entryFilePath = ?
    getDebugInfo = "string"
    proxyUser = ?
    rootPath = ?
    sparkConfig = {
      {customized property} = ?
    }
    sparkJobLinkedService = {
      parameters = {
        {customized property} = ?
      }
      referenceName = "string"
      type = "string"
    }
  }
}

For HDInsightStreaming, use:

{
  linkedServiceName = {
    parameters = {
      {customized property} = ?
    }
    referenceName = "string"
    type = "string"
  }
  policy = {
    retry = ?
    retryIntervalInSeconds = int
    secureOutput = bool
    timeout = ?
  }
  type = "HDInsightStreaming"
  typeProperties = {
    arguments = [
      ?
    ]
    combiner = ?
    commandEnvironment = [
      ?
    ]
    defines = {
      {customized property} = ?
    }
    fileLinkedService = {
      parameters = {
        {customized property} = ?
      }
      referenceName = "string"
      type = "string"
    }
    filePaths = [
      ?
    ]
    getDebugInfo = "string"
    input = ?
    mapper = ?
    output = ?
    reducer = ?
    storageLinkedServices = [
      {
        parameters = {
          {customized property} = ?
        }
        referenceName = "string"
        type = "string"
      }
    ]
  }
}

For Lookup, use:

{
  linkedServiceName = {
    parameters = {
      {customized property} = ?
    }
    referenceName = "string"
    type = "string"
  }
  policy = {
    retry = ?
    retryIntervalInSeconds = int
    secureOutput = bool
    timeout = ?
  }
  type = "Lookup"
  typeProperties = {
    dataset = {
      parameters = {
        {customized property} = ?
      }
      referenceName = "string"
      type = "string"
    }
    firstRowOnly = ?
    source = {
      sourceRetryCount = ?
      sourceRetryWait = ?
      type = "string"
      // For remaining properties, see CopySource objects
    }
  }
}

For SqlServerStoredProcedure, use:

{
  linkedServiceName = {
    parameters = {
      {customized property} = ?
    }
    referenceName = "string"
    type = "string"
  }
  policy = {
    retry = ?
    retryIntervalInSeconds = int
    secureOutput = bool
    timeout = ?
  }
  type = "SqlServerStoredProcedure"
  typeProperties = {
    storedProcedureName = ?
    storedProcedureParameters = {
      {customized property} = {
        type = "string"
        value = ?
      }
    }
  }
}

For WebActivity, use:

{
  linkedServiceName = {
    parameters = {
      {customized property} = ?
    }
    referenceName = "string"
    type = "string"
  }
  policy = {
    retry = ?
    retryIntervalInSeconds = int
    secureOutput = bool
    timeout = ?
  }
  type = "WebActivity"
  typeProperties = {
    authentication = {
      password = {
        type = "string"
        value = "string"
      }
      pfx = {
        type = "string"
        value = "string"
      }
      resource = "string"
      type = "string"
      username = "string"
    }
    body = ?
    datasets = [
      {
        parameters = {
          {customized property} = ?
        }
        referenceName = "string"
        type = "string"
      }
    ]
    disableCertValidation = bool
    headers = ?
    linkedServices = [
      {
        parameters = {
          {customized property} = ?
        }
        referenceName = "string"
        type = "string"
      }
    ]
    method = "string"
    url = ?
  }
}

Property values

Activity

Name	Description	Value
dependsOn	Activity depends on condition.	ActivityDependency[]
description	Activity description.	string
name	Activity name.	string (required)
type	Set to 'AzureMLBatchExecution' for type AzureMLBatchExecutionActivity. Set to 'AzureMLUpdateResource' for type AzureMLUpdateResourceActivity. Set to 'ExecutePipeline' for type ExecutePipelineActivity. Set to 'Filter' for type FilterActivity. Set to 'ForEach' for type ForEachActivity. Set to 'IfCondition' for type IfConditionActivity. Set to 'Until' for type UntilActivity. Set to 'Wait' for type WaitActivity. Set to 'Copy' for type CopyActivity. Set to 'Custom' for type CustomActivity. Set to 'DataLakeAnalyticsU-SQL' for type DataLakeAnalyticsUsqlActivity. Set to 'DatabricksNotebook' for type DatabricksNotebookActivity. Set to 'ExecuteSSISPackage' for type ExecuteSsisPackageActivity. Set to 'GetMetadata' for type GetMetadataActivity. Set to 'HDInsightHive' for type HDInsightHiveActivity. Set to 'HDInsightMapReduce' for type HDInsightMapReduceActivity. Set to 'HDInsightPig' for type HDInsightPigActivity. Set to 'HDInsightSpark' for type HDInsightSparkActivity. Set to 'HDInsightStreaming' for type HDInsightStreamingActivity. Set to 'Lookup' for type LookupActivity. Set to 'SqlServerStoredProcedure' for type SqlServerStoredProcedureActivity. Set to 'WebActivity' for type WebActivity.	'AzureMLBatchExecution' 'AzureMLUpdateResource' 'Copy' 'Custom' 'DatabricksNotebook' 'DataLakeAnalyticsU-SQL' 'ExecutePipeline' 'ExecuteSSISPackage' 'Filter' 'ForEach' 'GetMetadata' 'HDInsightHive' 'HDInsightMapReduce' 'HDInsightPig' 'HDInsightSpark' 'HDInsightStreaming' 'IfCondition' 'Lookup' 'SqlServerStoredProcedure' 'Until' 'Wait' 'WebActivity' (required)

ActivityDependency

Name	Description	Value
activity	Activity name.	string (required)
dependencyConditions	Match-Condition for the dependency.	String array containing any of: 'Completed' 'Failed' 'Skipped' 'Succeeded' (required)

ActivityPolicy

Name	Description	Value
retry	Maximum ordinary retry attempts. Default is 0. Type: integer (or Expression with resultType integer), minimum: 0.	any
retryIntervalInSeconds	Interval between each retry attempt (in seconds). The default is 30 sec.	int Constraints: Min value = 30 Max value = 86400
secureOutput	When set to true, Output from activity is considered as secure and will not be logged to monitoring.	bool
timeout	Specifies the timeout for the activity to run. The default timeout is 7 days. Type: string (or Expression with resultType string), pattern: ((\d+).)?(\d\d):(60	([0-5][0-9])):(60	([0-5][0-9])).	any

AzureKeyVaultSecretReference

Name	Description	Value
secretName	The name of the secret in Azure Key Vault. Type: string (or Expression with resultType string).	any (required)
secretVersion	The version of the secret in Azure Key Vault. The default value is the latest version of the secret. Type: string (or Expression with resultType string).	any
store	The Azure Key Vault linked service reference.	LinkedServiceReference (required)
type	Type of the secret.	'AzureKeyVaultSecret' (required)

AzureMLBatchExecutionActivity

Name	Description	Value
linkedServiceName	Linked service reference.	LinkedServiceReference
policy	Activity policy.	ActivityPolicy
type	Type of activity.	'AzureMLBatchExecution' (required)
typeProperties	Azure ML Batch Execution activity properties.	AzureMLBatchExecutionActivityTypeProperties (required)

AzureMLBatchExecutionActivityTypeProperties

Name	Description	Value
globalParameters	Key,Value pairs to be passed to the Azure ML Batch Execution Service endpoint. Keys must match the names of web service parameters defined in the published Azure ML web service. Values will be passed in the GlobalParameters property of the Azure ML batch execution request.	AzureMLBatchExecutionActivityTypePropertiesGlobalParameters
webServiceInputs	Key,Value pairs, mapping the names of Azure ML endpoint's Web Service Inputs to AzureMLWebServiceFile objects specifying the input Blob locations.. This information will be passed in the WebServiceInputs property of the Azure ML batch execution request.	AzureMLBatchExecutionActivityTypePropertiesWebServiceInputs
webServiceOutputs	Key,Value pairs, mapping the names of Azure ML endpoint's Web Service Outputs to AzureMLWebServiceFile objects specifying the output Blob locations. This information will be passed in the WebServiceOutputs property of the Azure ML batch execution request.	AzureMLBatchExecutionActivityTypePropertiesWebServiceOutputs

AzureMLBatchExecutionActivityTypePropertiesGlobalParameters

Name	Description	Value

AzureMLBatchExecutionActivityTypePropertiesWebServiceInputs

Name	Description	Value

AzureMLBatchExecutionActivityTypePropertiesWebServiceOutputs

Name	Description	Value

AzureMLUpdateResourceActivity

Name	Description	Value
linkedServiceName	Linked service reference.	LinkedServiceReference
policy	Activity policy.	ActivityPolicy
type	Type of activity.	'AzureMLUpdateResource' (required)
typeProperties	Azure ML Update Resource management activity properties.	AzureMLUpdateResourceActivityTypeProperties (required)

AzureMLUpdateResourceActivityTypeProperties

Name	Description	Value
trainedModelFilePath	The relative file path in trainedModelLinkedService to represent the .ilearner file that will be uploaded by the update operation. Type: string (or Expression with resultType string).	any (required)
trainedModelLinkedServiceName	Name of Azure Storage linked service holding the .ilearner file that will be uploaded by the update operation.	LinkedServiceReference (required)
trainedModelName	Name of the Trained Model module in the Web Service experiment to be updated. Type: string (or Expression with resultType string).	any (required)

AzureMLWebServiceFile

Name	Description	Value
filePath	The relative file path, including container name, in the Azure Blob Storage specified by the LinkedService. Type: string (or Expression with resultType string).	any (required)
linkedServiceName	Reference to an Azure Storage LinkedService, where Azure ML WebService Input/Output file located.	LinkedServiceReference (required)

CopyActivity

Name	Description	Value
inputs	List of inputs for the activity.	DatasetReference[]
linkedServiceName	Linked service reference.	LinkedServiceReference
outputs	List of outputs for the activity.	DatasetReference[]
policy	Activity policy.	ActivityPolicy
type	Type of activity.	'Copy' (required)
typeProperties	Copy activity properties.	CopyActivityTypeProperties (required)

CopyActivityTypeProperties

Name	Description	Value
cloudDataMovementUnits	Maximum number of cloud data movement units that can be used to perform this data movement. Type: integer (or Expression with resultType integer), minimum: 0.	any
enableSkipIncompatibleRow	Whether to skip incompatible row. Default value is false. Type: boolean (or Expression with resultType boolean).	any
enableStaging	Specifies whether to copy data via an interim staging. Default value is false. Type: boolean (or Expression with resultType boolean).	any
parallelCopies	Maximum number of concurrent sessions opened on the source or sink to avoid overloading the data store. Type: integer (or Expression with resultType integer), minimum: 0.	any
redirectIncompatibleRowSettings	Redirect incompatible row settings when EnableSkipIncompatibleRow is true.	RedirectIncompatibleRowSettings
sink	Copy activity sink.	CopySink (required)
source	Copy activity source.	CopySource (required)
stagingSettings	Specifies interim staging settings when EnableStaging is true.	StagingSettings
translator	Copy activity translator. If not specified, tabular translator is used.	any

CopySink

Name	Description	Value
sinkRetryCount	Sink retry count. Type: integer (or Expression with resultType integer).	any
sinkRetryWait	Sink retry wait. Type: string (or Expression with resultType string), pattern: ((\d+).)?(\d\d):(60	([0-5][0-9])):(60	([0-5][0-9])).	any
type		(required)
writeBatchSize	Write batch size. Type: integer (or Expression with resultType integer), minimum: 0.	any
writeBatchTimeout	Write batch timeout. Type: string (or Expression with resultType string), pattern: ((\d+).)?(\d\d):(60	([0-5][0-9])):(60	([0-5][0-9])).	any

CopySource

Name	Description	Value
sourceRetryCount	Source retry count. Type: integer (or Expression with resultType integer).	any
sourceRetryWait	Source retry wait. Type: string (or Expression with resultType string), pattern: ((\d+).)?(\d\d):(60	([0-5][0-9])):(60	([0-5][0-9])).	any
type		(required)

CustomActivity

Name	Description	Value
linkedServiceName	Linked service reference.	LinkedServiceReference
policy	Activity policy.	ActivityPolicy
type	Type of activity.	'Custom' (required)
typeProperties	Custom activity properties.	CustomActivityTypeProperties (required)

CustomActivityReferenceObject

Name	Description	Value
datasets	Dataset references.	DatasetReference[]
linkedServices	Linked service references.	LinkedServiceReference[]

CustomActivityTypeProperties

Name	Description	Value
command	Command for custom activity Type: string (or Expression with resultType string).	any (required)
extendedProperties	User defined property bag. There is no restriction on the keys or values that can be used. The user specified custom activity has the full responsibility to consume and interpret the content defined.	CustomActivityTypePropertiesExtendedProperties
folderPath	Folder path for resource files Type: string (or Expression with resultType string).	any
referenceObjects	Reference objects	CustomActivityReferenceObject
resourceLinkedService	Resource linked service reference.	LinkedServiceReference

CustomActivityTypePropertiesExtendedProperties

Name	Description	Value

DatabricksNotebookActivity

Name	Description	Value
linkedServiceName	Linked service reference.	LinkedServiceReference
policy	Activity policy.	ActivityPolicy
type	Type of activity.	'DatabricksNotebook' (required)
typeProperties	Databricks Notebook activity properties.	DatabricksNotebookActivityTypeProperties (required)

DatabricksNotebookActivityTypeProperties

Name	Description	Value
baseParameters	Base parameters to be used for each run of this job.If the notebook takes a parameter that is not specified, the default value from the notebook will be used.	DatabricksNotebookActivityTypePropertiesBaseParameters
notebookPath	The absolute path of the notebook to be run in the Databricks Workspace. This path must begin with a slash. Type: string (or Expression with resultType string).	any (required)

DatabricksNotebookActivityTypePropertiesBaseParameters

Name	Description	Value

DataLakeAnalyticsUsqlActivity

Name	Description	Value
linkedServiceName	Linked service reference.	LinkedServiceReference
policy	Activity policy.	ActivityPolicy
type	Type of activity.	'DataLakeAnalyticsU-SQL' (required)
typeProperties	Data Lake Analytics U-SQL activity properties.	DataLakeAnalyticsUsqlActivityTypeProperties (required)

DataLakeAnalyticsUsqlActivityTypeProperties

Name	Description	Value
compilationMode	Compilation mode of U-SQL. Must be one of these values : Semantic, Full and SingleBox. Type: string (or Expression with resultType string).	any
degreeOfParallelism	The maximum number of nodes simultaneously used to run the job. Default value is 1. Type: integer (or Expression with resultType integer), minimum: 1.	any
parameters	Parameters for U-SQL job request.	DataLakeAnalyticsUsqlActivityTypePropertiesParameters
priority	Determines which jobs out of all that are queued should be selected to run first. The lower the number, the higher the priority. Default value is 1000. Type: integer (or Expression with resultType integer), minimum: 1.	any
runtimeVersion	Runtime version of the U-SQL engine to use. Type: string (or Expression with resultType string).	any
scriptLinkedService	Script linked service reference.	LinkedServiceReference (required)
scriptPath	Case-sensitive path to folder that contains the U-SQL script. Type: string (or Expression with resultType string).	any (required)

DataLakeAnalyticsUsqlActivityTypePropertiesParameters

Name	Description	Value

DatasetReference

Name	Description	Value
parameters	Arguments for dataset.	ParameterValueSpecification
referenceName	Reference dataset name.	string (required)
type	Dataset reference type.	'DatasetReference' (required)

ExecutePipelineActivity

Name	Description	Value
type	Type of activity.	'ExecutePipeline' (required)
typeProperties	Execute pipeline activity properties.	ExecutePipelineActivityTypeProperties (required)

ExecutePipelineActivityTypeProperties

Name	Description	Value
parameters	Pipeline parameters.	ParameterValueSpecification
pipeline	Pipeline reference.	PipelineReference (required)
waitOnCompletion	Defines whether activity execution will wait for the dependent pipeline execution to finish. Default is false.	bool

ExecuteSsisPackageActivity

Name	Description	Value
linkedServiceName	Linked service reference.	LinkedServiceReference
policy	Activity policy.	ActivityPolicy
type	Type of activity.	'ExecuteSSISPackage' (required)
typeProperties	Execute SSIS package activity properties.	ExecuteSsisPackageActivityTypeProperties (required)

ExecuteSsisPackageActivityTypeProperties

Name	Description	Value
connectVia	The integration runtime reference.	IntegrationRuntimeReference (required)
environmentPath	The environment path to execute the SSIS package. Type: string (or Expression with resultType string).	any
executionCredential	The package execution credential.	SsisExecutionCredential
loggingLevel	The logging level of SSIS package execution. Type: string (or Expression with resultType string).	any
logLocation	SSIS package execution log location.	SsisLogLocation
packageConnectionManagers	The package level connection managers to execute the SSIS package.	ExecuteSsisPackageActivityTypePropertiesPackageConnectionManagers
packageLocation	SSIS package location.	SsisPackageLocation (required)
packageParameters	The package level parameters to execute the SSIS package.	ExecuteSsisPackageActivityTypePropertiesPackageParameters
projectConnectionManagers	The project level connection managers to execute the SSIS package.	ExecuteSsisPackageActivityTypePropertiesProjectConnectionManagers
projectParameters	The project level parameters to execute the SSIS package.	ExecuteSsisPackageActivityTypePropertiesProjectParameters
propertyOverrides	The property overrides to execute the SSIS package.	ExecuteSsisPackageActivityTypePropertiesPropertyOverrides
runtime	Specifies the runtime to execute SSIS package. The value should be "x86" or "x64". Type: string (or Expression with resultType string).	any

ExecuteSsisPackageActivityTypePropertiesPackageConnectionManagers

Name	Description	Value

ExecuteSsisPackageActivityTypePropertiesPackageParameters

Name	Description	Value

ExecuteSsisPackageActivityTypePropertiesProjectConnectionManagers

Name	Description	Value

ExecuteSsisPackageActivityTypePropertiesProjectParameters

Name	Description	Value

ExecuteSsisPackageActivityTypePropertiesPropertyOverrides

Name	Description	Value

Expression

Name	Description	Value
type	Expression type.	'Expression' (required)
value	Expression value.	string (required)

FilterActivity

Name	Description	Value
type	Type of activity.	'Filter' (required)
typeProperties	Filter activity properties.	FilterActivityTypeProperties (required)

FilterActivityTypeProperties

Name	Description	Value
condition	Condition to be used for filtering the input.	Expression (required)
items	Input array on which filter should be applied.	Expression (required)

ForEachActivity

Name	Description	Value
type	Type of activity.	'ForEach' (required)
typeProperties	ForEach activity properties.	ForEachActivityTypeProperties (required)

ForEachActivityTypeProperties

Name	Description	Value
activities	List of activities to execute .	Activity[] (required)
batchCount	Batch count to be used for controlling the number of parallel execution (when isSequential is set to false).	int Constraints: Max value = 50
isSequential	Should the loop be executed in sequence or in parallel (max 50)	bool
items	Collection to iterate.	Expression (required)

GetMetadataActivity

Name	Description	Value
linkedServiceName	Linked service reference.	LinkedServiceReference
policy	Activity policy.	ActivityPolicy
type	Type of activity.	'GetMetadata' (required)
typeProperties	GetMetadata activity properties.	GetMetadataActivityTypeProperties (required)

GetMetadataActivityTypeProperties

Name	Description	Value
dataset	GetMetadata activity dataset reference.	DatasetReference (required)
fieldList	Fields of metadata to get from dataset.	any[]

HDInsightHiveActivity

Name	Description	Value
linkedServiceName	Linked service reference.	LinkedServiceReference
policy	Activity policy.	ActivityPolicy
type	Type of activity.	'HDInsightHive' (required)
typeProperties	HDInsight Hive activity properties.	HDInsightHiveActivityTypeProperties (required)

HDInsightHiveActivityTypeProperties

Name	Description	Value
arguments	User specified arguments to HDInsightActivity.	any[]
defines	Allows user to specify defines for Hive job request.	HDInsightHiveActivityTypePropertiesDefines
getDebugInfo	Debug info option.	'Always' 'Failure' 'None'
scriptLinkedService	Script linked service reference.	LinkedServiceReference
scriptPath	Script path. Type: string (or Expression with resultType string).	any
storageLinkedServices	Storage linked service references.	LinkedServiceReference[]

HDInsightHiveActivityTypePropertiesDefines

Name	Description	Value

HDInsightMapReduceActivity

Name	Description	Value
linkedServiceName	Linked service reference.	LinkedServiceReference
policy	Activity policy.	ActivityPolicy
type	Type of activity.	'HDInsightMapReduce' (required)
typeProperties	HDInsight MapReduce activity properties.	HDInsightMapReduceActivityTypeProperties (required)

HDInsightMapReduceActivityTypeProperties

Name	Description	Value
arguments	User specified arguments to HDInsightActivity.	any[]
className	Class name. Type: string (or Expression with resultType string).	any (required)
defines	Allows user to specify defines for the MapReduce job request.	HDInsightMapReduceActivityTypePropertiesDefines
getDebugInfo	Debug info option.	'Always' 'Failure' 'None'
jarFilePath	Jar path. Type: string (or Expression with resultType string).	any (required)
jarLibs	Jar libs.	any[]
jarLinkedService	Jar linked service reference.	LinkedServiceReference
storageLinkedServices	Storage linked service references.	LinkedServiceReference[]

HDInsightMapReduceActivityTypePropertiesDefines

Name	Description	Value

HDInsightPigActivity

Name	Description	Value
linkedServiceName	Linked service reference.	LinkedServiceReference
policy	Activity policy.	ActivityPolicy
type	Type of activity.	'HDInsightPig' (required)
typeProperties	HDInsight Pig activity properties.	HDInsightPigActivityTypeProperties (required)

HDInsightPigActivityTypeProperties

Name	Description	Value
arguments	User specified arguments to HDInsightActivity.	any[]
defines	Allows user to specify defines for Pig job request.	HDInsightPigActivityTypePropertiesDefines
getDebugInfo	Debug info option.	'Always' 'Failure' 'None'
scriptLinkedService	Script linked service reference.	LinkedServiceReference
scriptPath	Script path. Type: string (or Expression with resultType string).	any
storageLinkedServices	Storage linked service references.	LinkedServiceReference[]

HDInsightPigActivityTypePropertiesDefines

Name	Description	Value

HDInsightSparkActivity

Name	Description	Value
linkedServiceName	Linked service reference.	LinkedServiceReference
policy	Activity policy.	ActivityPolicy
type	Type of activity.	'HDInsightSpark' (required)
typeProperties	HDInsight spark activity properties.	HDInsightSparkActivityTypeProperties (required)

HDInsightSparkActivityTypeProperties

Name	Description	Value
arguments	The user-specified arguments to HDInsightSparkActivity.	any[]
className	The application's Java/Spark main class.	string
entryFilePath	The relative path to the root folder of the code/package to be executed. Type: string (or Expression with resultType string).	any (required)
getDebugInfo	Debug info option.	'Always' 'Failure' 'None'
proxyUser	The user to impersonate that will execute the job. Type: string (or Expression with resultType string).	any
rootPath	The root path in 'sparkJobLinkedService' for all the job’s files. Type: string (or Expression with resultType string).	any (required)
sparkConfig	Spark configuration property.	HDInsightSparkActivityTypePropertiesSparkConfig
sparkJobLinkedService	The storage linked service for uploading the entry file and dependencies, and for receiving logs.	LinkedServiceReference

HDInsightSparkActivityTypePropertiesSparkConfig

Name	Description	Value

HDInsightStreamingActivity

Name	Description	Value
linkedServiceName	Linked service reference.	LinkedServiceReference
policy	Activity policy.	ActivityPolicy
type	Type of activity.	'HDInsightStreaming' (required)
typeProperties	HDInsight streaming activity properties.	HDInsightStreamingActivityTypeProperties (required)

HDInsightStreamingActivityTypeProperties

Name	Description	Value
arguments	User specified arguments to HDInsightActivity.	any[]
combiner	Combiner executable name. Type: string (or Expression with resultType string).	any
commandEnvironment	Command line environment values.	any[]
defines	Allows user to specify defines for streaming job request.	HDInsightStreamingActivityTypePropertiesDefines
fileLinkedService	Linked service reference where the files are located.	LinkedServiceReference
filePaths	Paths to streaming job files. Can be directories.	any[] (required)
getDebugInfo	Debug info option.	'Always' 'Failure' 'None'
input	Input blob path. Type: string (or Expression with resultType string).	any (required)
mapper	Mapper executable name. Type: string (or Expression with resultType string).	any (required)
output	Output blob path. Type: string (or Expression with resultType string).	any (required)
reducer	Reducer executable name. Type: string (or Expression with resultType string).	any (required)
storageLinkedServices	Storage linked service references.	LinkedServiceReference[]

HDInsightStreamingActivityTypePropertiesDefines

Name	Description	Value

IfConditionActivity

Name	Description	Value
type	Type of activity.	'IfCondition' (required)
typeProperties	IfCondition activity properties.	IfConditionActivityTypeProperties (required)

IfConditionActivityTypeProperties

Name	Description	Value
expression	An expression that would evaluate to Boolean. This is used to determine the block of activities (ifTrueActivities or ifFalseActivities) that will be executed.	Expression (required)
ifFalseActivities	List of activities to execute if expression is evaluated to false. This is an optional property and if not provided, the activity will exit without any action.	Activity[]
ifTrueActivities	List of activities to execute if expression is evaluated to true. This is an optional property and if not provided, the activity will exit without any action.	Activity[]

IntegrationRuntimeReference

Name	Description	Value
parameters	Arguments for integration runtime.	ParameterValueSpecification
referenceName	Reference integration runtime name.	string (required)
type	Type of integration runtime.	'IntegrationRuntimeReference' (required)

LinkedServiceReference

Name	Description	Value
parameters	Arguments for LinkedService.	ParameterValueSpecification
referenceName	Reference LinkedService name.	string (required)
type	Linked service reference type.	'LinkedServiceReference' (required)

LookupActivity

Name	Description	Value
linkedServiceName	Linked service reference.	LinkedServiceReference
policy	Activity policy.	ActivityPolicy
type	Type of activity.	'Lookup' (required)
typeProperties	Lookup activity properties.	LookupActivityTypeProperties (required)

LookupActivityTypeProperties

Name	Description	Value
dataset	Lookup activity dataset reference.	DatasetReference (required)
firstRowOnly	Whether to return first row or all rows. Default value is true. Type: boolean (or Expression with resultType boolean).	any
source	Dataset-specific source properties, same as copy activity source.	CopySource (required)

Microsoft.DataFactory/factories/pipelines

Name	Description	Value
name	The resource name	string Constraints: Min length = 1 Max length = 1 Pattern = ^[A-Za-z0-9_][^<>*#.%&:\\+?/]*$ (required)
parent_id	The ID of the resource that is the parent for this resource.	ID for resource of type: factories
properties	Properties of the pipeline.	Pipeline (required)
type	The resource type	"Microsoft.DataFactory/factories/pipelines@2017-09-01-preview"

ParameterDefinitionSpecification

Name	Description	Value

ParameterSpecification

Name	Description	Value
defaultValue	Default value of parameter.	any
type	Parameter type.	'Array' 'Bool' 'Float' 'Int' 'Object' 'SecureString' 'String' (required)

ParameterValueSpecification

Name	Description	Value

ParameterValueSpecification

Name	Description	Value

ParameterValueSpecification

Name	Description	Value

ParameterValueSpecification

Name	Description	Value

Pipeline

Name	Description	Value
activities	List of activities in pipeline.	Activity[]
annotations	List of tags that can be used for describing the Pipeline.	any[]
concurrency	The max number of concurrent runs for the pipeline.	int Constraints: Min value = 1
description	The description of the pipeline.	string
parameters	List of parameters for pipeline.	ParameterDefinitionSpecification

PipelineReference

Name	Description	Value
name	Reference name.	string
referenceName	Reference pipeline name.	string (required)
type	Pipeline reference type.	'PipelineReference' (required)

RedirectIncompatibleRowSettings

Name	Description	Value
linkedServiceName	Name of the Azure Storage, Storage SAS, or Azure Data Lake Store linked service used for redirecting incompatible row. Must be specified if redirectIncompatibleRowSettings is specified. Type: string (or Expression with resultType string).	any (required)
path	The path for storing the redirect incompatible row data. Type: string (or Expression with resultType string).	any

SecretBase

Name	Description	Value
type	Set to 'AzureKeyVaultSecret' for type AzureKeyVaultSecretReference. Set to 'SecureString' for type SecureString.	'AzureKeyVaultSecret' 'SecureString' (required)

SecureString

Name	Description	Value
type	Type of the secret.	string (required)
value	Value of secure string.	string (required)

SecureString

Name	Description	Value
type	Type of the secret.	'SecureString' (required)
value	Value of secure string.	string (required)

SqlServerStoredProcedureActivity

Name	Description	Value
linkedServiceName	Linked service reference.	LinkedServiceReference
policy	Activity policy.	ActivityPolicy
type	Type of activity.	'SqlServerStoredProcedure' (required)
typeProperties	SQL stored procedure activity properties.	SqlServerStoredProcedureActivityTypeProperties (required)

SqlServerStoredProcedureActivityTypeProperties

Name	Description	Value
storedProcedureName	Stored procedure name. Type: string (or Expression with resultType string).	any (required)
storedProcedureParameters	Value and type setting for stored procedure parameters. Example: "{Parameter1: {value: "1", type: "int"}}".	SqlServerStoredProcedureActivityTypePropertiesStoredProcedureParameters

SqlServerStoredProcedureActivityTypePropertiesStoredProcedureParameters

Name	Description	Value

SsisAccessCredential

Name	Description	Value
domain	Domain for windows authentication.	any (required)
password	Password for windows authentication.	SecretBase (required)
userName	UseName for windows authentication.	any (required)

SsisConnectionManager

Name	Description	Value

SsisConnectionManager

Name	Description	Value

SsisExecutionCredential

Name	Description	Value
domain	Domain for windows authentication.	any (required)
password	Password for windows authentication.	SecureString (required)
userName	UseName for windows authentication.	any (required)

SsisExecutionParameter

Name	Description	Value
value	SSIS package execution parameter value. Type: string (or Expression with resultType string).	any (required)

SsisLogLocation

Name	Description	Value
logPath	The SSIS package execution log path. Type: string (or Expression with resultType string).	any (required)
type	The type of SSIS log location.	'File' (required)
typeProperties	SSIS package execution log location properties.	SsisLogLocationTypeProperties (required)

SsisLogLocationTypeProperties

Name	Description	Value
accessCredential	The package execution log access credential.	SsisAccessCredential
logRefreshInterval	Specifies the interval to refresh log. The default interval is 5 minutes. Type: string (or Expression with resultType string), pattern: ((\d+).)?(\d\d):(60	([0-5][0-9])):(60	([0-5][0-9])).	any

SsisPackageLocation

Name	Description	Value
packagePath	The SSIS package path. Type: string (or Expression with resultType string).	any (required)
type	The type of SSIS package location.	'File' 'SSISDB'
typeProperties	SSIS package location properties.	SsisPackageLocationTypeProperties

SsisPackageLocationTypeProperties

Name	Description	Value
accessCredential	The package access credential.	SsisAccessCredential
configurationPath	The configuration file of the package execution. Type: string (or Expression with resultType string).	any
packagePassword	Password of the package.	SecretBase

SsisPropertyOverride

Name	Description	Value
isSensitive	Whether SSIS package property override value is sensitive data. Value will be encrypted in SSISDB if it is true	bool
value	SSIS package property override value. Type: string (or Expression with resultType string).	any (required)

StagingSettings

Name	Description	Value
enableCompression	Specifies whether to use compression when copying data via an interim staging. Default value is false. Type: boolean (or Expression with resultType boolean).	any
linkedServiceName	Staging linked service reference.	LinkedServiceReference (required)
path	The path to storage for storing the interim data. Type: string (or Expression with resultType string).	any

StoredProcedureParameter

Name	Description	Value
type	Stored procedure parameter type.	'Boolean' 'Date' 'Decimal' 'Guid' 'Int' 'Int64' 'String'
value	Stored procedure parameter value. Type: string (or Expression with resultType string).	any (required)

UntilActivity

Name	Description	Value
type	Type of activity.	'Until' (required)
typeProperties	Until activity properties.	UntilActivityTypeProperties (required)

UntilActivityTypeProperties

Name	Description	Value
activities	List of activities to execute.	Activity[] (required)
expression	An expression that would evaluate to Boolean. The loop will continue until this expression evaluates to true	Expression (required)
timeout	Specifies the timeout for the activity to run. If there is no value specified, it takes the value of TimeSpan.FromDays(7) which is 1 week as default. Type: string (or Expression with resultType string), pattern: ((\d+).)?(\d\d):(60	([0-5][0-9])):(60	([0-5][0-9])). Type: string (or Expression with resultType string), pattern: ((\d+).)?(\d\d):(60	([0-5][0-9])):(60	([0-5][0-9])).	any

WaitActivity

Name	Description	Value
type	Type of activity.	'Wait' (required)
typeProperties	Wait activity properties.	WaitActivityTypeProperties (required)

WaitActivityTypeProperties

Name	Description	Value
waitTimeInSeconds	Duration in seconds.	int (required)

WebActivity

Name	Description	Value
linkedServiceName	Linked service reference.	LinkedServiceReference
policy	Activity policy.	ActivityPolicy
type	Type of activity.	'WebActivity' (required)
typeProperties	Web activity properties.	WebActivityTypeProperties (required)

WebActivityAuthentication

Name	Description	Value
password	Password for the PFX file or basic authentication.	SecureString
pfx	Base64-encoded contents of a PFX file.	SecureString
resource	Resource for which Azure Auth token will be requested when using MSI Authentication.	string
type	Web activity authentication (Basic/ClientCertificate/MSI)	string (required)
username	Web activity authentication user name for basic authentication.	string

WebActivityTypeProperties

Name	Description	Value
authentication	Authentication method used for calling the endpoint.	WebActivityAuthentication
body	Represents the payload that will be sent to the endpoint. Required for POST/PUT method, not allowed for GET method Type: string (or Expression with resultType string).	any
datasets	List of datasets passed to web endpoint.	DatasetReference[]
disableCertValidation	When set to true, Certificate validation will be disabled.	bool
headers	Represents the headers that will be sent to the request. For example, to set the language and type on a request: "headers" : { "Accept-Language": "en-us", "Content-Type": "application/json" }. Type: string (or Expression with resultType string).	any
linkedServices	List of linked services passed to web endpoint.	LinkedServiceReference[]
method	Rest API method for target endpoint.	'DELETE' 'GET' 'POST' 'PUT' (required)
url	Web activity target endpoint and path. Type: string (or Expression with resultType string).	any (required)