SparkJobProperties Class
Definition
Important
Some information relates to prerelease product that may be substantially modified before it’s released. Microsoft makes no warranties, express or implied, with respect to the information provided here.
The properties of the Spark job.
[System.Text.Json.Serialization.JsonConverter(typeof(Azure.Analytics.Synapse.Artifacts.Models.SparkJobProperties+SparkJobPropertiesConverter))]
public class SparkJobProperties
[<System.Text.Json.Serialization.JsonConverter(typeof(Azure.Analytics.Synapse.Artifacts.Models.SparkJobProperties+SparkJobPropertiesConverter))>]
type SparkJobProperties = class
Public Class SparkJobProperties
- Inheritance
-
SparkJobProperties
- Attributes
Constructors
SparkJobProperties(String, String, Int32, String, Int32, Int32) |
Initializes a new instance of SparkJobProperties. |
Properties
AdditionalProperties |
Additional Properties. |
Archives |
Archives to be used in this job. |
Args |
Command line arguments for the application. |
ClassName |
Main class for Java/Scala application. |
Conf |
Spark configuration properties. |
DriverCores |
Number of cores to use for the driver. |
DriverMemory |
Amount of memory to use for the driver process. |
ExecutorCores |
Number of cores to use for each executor. |
ExecutorMemory |
Amount of memory to use per executor process. |
File |
File containing the application to execute. |
Files |
files to be used in this job. |
Jars |
Jars to be used in this job. |
Name |
The name of the job. |
NumExecutors |
Number of executors to launch for this job. |