SparkSection Class

Defines Spark settings to use for the PySpark framework in the environment.

This SparkSection class is used in the Environment class.

Class SparkSection constructor.

Inheritance

azureml._base_sdk_common.abstract_run_config_element._AbstractRunConfigElement

SparkSection

Constructor

SparkSection(**kwargs)

Variables

Name	Description
repositories	list A list of Spark repositories.
packages	list The packages to use.
precache_packages	bool Indicates Whether to precache the packages.