New-AzHDInsightMapReduceJobDefinition
Creates a MapReduce job object.
Syntax
New-AzHDInsightMapReduceJobDefinition
[-Arguments <String[]>]
[-Files <String[]>]
[-StatusFolder <String>]
-ClassName <String>
[-Defines <Hashtable>]
-JarFile <String>
[-JobName <String>]
[-LibJars <String[]>]
[-DefaultProfile <IAzureContextContainer>]
[<CommonParameters>] Description
The New-AzHDInsightMapReduceJobDefinition cmdlet defines a new MapReduce job for use with an Azure HDInsight cluster.
Examples
Example 1: Create a MapReduce job definition
# Cluster info
$clusterName = "your-hadoop-001"
$clusterCreds = Get-Credential
New-AzHDInsightMapReduceJobDefinition -StatusFolder $statusFolder `
-ClassName $className `
-JarFile $jarFilePath `
| Start-AzHDInsightJob `
-ClusterName $clusterName `
-ClusterCredential $clusterCredsThis command creates a MapReduce job definition.
Parameters
-Arguments
Specifies an array of arguments for the job. The arguments are passed as command-line arguments to each task.
| Type: | String[] |
| Position: | Named |
| Default value: | None |
| Required: | False |
| Accept pipeline input: | False |
| Accept wildcard characters: | False |
-ClassName
Specifies the job class in the JAR file.
| Type: | String |
| Position: | Named |
| Default value: | None |
| Required: | True |
| Accept pipeline input: | False |
| Accept wildcard characters: | False |
-DefaultProfile
The credentials, account, tenant, and subscription used for communication with azure
| Type: | IAzureContextContainer |
| Aliases: | AzContext, AzureRmContext, AzureCredential |
| Position: | Named |
| Default value: | None |
| Required: | False |
| Accept pipeline input: | False |
| Accept wildcard characters: | False |
-Defines
Specifies Hadoop configuration values to set for when the job runs.
| Type: | Hashtable |
| Position: | Named |
| Default value: | None |
| Required: | False |
| Accept pipeline input: | False |
| Accept wildcard characters: | False |
-Files
Specifies a collection of files that are associated with a Hive job.
| Type: | String[] |
| Position: | Named |
| Default value: | None |
| Required: | False |
| Accept pipeline input: | False |
| Accept wildcard characters: | False |
-JarFile
Specifies the JAR file to use for the job.
| Type: | String |
| Position: | Named |
| Default value: | None |
| Required: | True |
| Accept pipeline input: | False |
| Accept wildcard characters: | False |
-JobName
Specifies the name of the job.
| Type: | String |
| Position: | Named |
| Default value: | None |
| Required: | False |
| Accept pipeline input: | False |
| Accept wildcard characters: | False |
-LibJars
Specifies the lib JARS for the job.
| Type: | String[] |
| Position: | Named |
| Default value: | None |
| Required: | False |
| Accept pipeline input: | False |
| Accept wildcard characters: | False |
-StatusFolder
Specifies the location of the folder that contains standard outputs and error outputs for a job.
| Type: | String |
| Position: | Named |
| Default value: | None |
| Required: | False |
| Accept pipeline input: | False |
| Accept wildcard characters: | False |
Inputs
None
Outputs
AzureHDInsightMapReduceJobDefinition
