SparkSection Class
Defines Spark settings to use for the PySpark framework in the environment.
This SparkSection class is used in the Environment class.
Class SparkSection constructor.
- Inheritance
-
azureml._base_sdk_common.abstract_run_config_element._AbstractRunConfigElementSparkSection
Constructor
SparkSection(**kwargs)
Variables
Name | Description |
---|---|
repositories
|
A list of Spark repositories. |
packages
|
The packages to use. |
precache_packages
|
Indicates Whether to precache the packages. |