AutoMLStep Class

Reference

Creates an Azure ML Pipeline step that encapsulates an automated ML run.

For an example of using AutoMLStep, see the notebook https://aka.ms/pl-automl.

Initialize an AutoMLStep.

Inheritance: PipelineStep

AutoMLStep

Constructor

AutoMLStep(name, automl_config, inputs=None, outputs=None, script_repl_params=None, allow_reuse=True, version=None, hash_paths=None, enable_default_model_output=True, enable_default_metrics_output=True, **kwargs)

Parameters

Name	Description
name Required	str The name of the step.
automl_config Required	AutoMLConfig An AutoMLConfig object that defines the configuration for this AutoML run.
inputs	list[Union[InputPortBinding, DataReference, PortDataReference, PipelineData]] A list of input port bindings. Default value: None
outputs	list[Union[PipelineData, OutputPortBinding]] A list of output port bindings. Default value: None
script_repl_params	dict Optional parameters to be replaced in a script, for example {'param1': 'value1', 'param2': 'value2'}. Default value: None
allow_reuse	bool Indicates whether the step should reuse previous results when re-run with the same settings. Reuse is enabled by default. If the step contents (scripts/dependencies) as well as inputs and parameters remain unchanged, the output from the previous run of this step is reused. When reusing the step, instead of submitting the job to compute, the results from the previous run are immediately made available to any subsequent steps. If you use Azure Machine Learning datasets as inputs, reuse is determined by whether the dataset's definition has changed, not by whether the underlying data has changed. Default value: True
version	str A version to assign to the step. Default value: None
hash_paths	list DEPRECATED. A list of paths to hash when checking for changes to the pipeline step contents. By default, all files under the `path` parameter in AutoMLConfig are hashed except files listed in .amlignore or .gitignore under `path`. If there are no changes detected, the pipeline reuses the step contents from a previous run. Default value: None
enable_default_model_output	bool Indicates whether or not the best model will be added as a default output. This can be used to retrieve the best model after the run has completed using the AutoMLStepRun class. Note, if the default model output is not required, it is recommended to set this parameter to `False`. Default value: True
enable_default_metrics_output	bool Indicates whether or not all child run metrics will be added as a default output. This can be used to retrieve the child run metrics after the run has completed using the AutoMLStepRun class. Note, if the default metrics output is not required, it is recommended to set this parameter to `False`. Default value: True
name Required	str The name of the step.
automl_config Required	AutoMLConfig An AutoMLConfig that defines the configuration for this AutoML run.
inputs Required	list[Union[InputPortBinding, DataReference, PortDataReference, PipelineData]] A list of input port bindings.
outputs Required	list[Union[PipelineData, OutputPortBinding]] A list of output port bindings.
script_repl_params Required	dict Optional parameters to be replaced in a script, for example {'param1': 'value1', 'param2': 'value2'}.
script_repl_params Required	Optional parameters to be replaced in a script.
allow_reuse Required	bool Indicates whether the step should reuse previous results when re-run with the same settings. Reuse is enabled by default. If the step contents (scripts/dependencies) as well as inputs and parameters remain unchanged, the output from the previous run of this step is reused. When reusing the step, instead of submitting the job to compute, the results from the previous run are immediately made available to any subsequent steps. If you use Azure Machine Learning datasets as inputs, reuse is determined by whether the dataset's definition has changed, not by whether the underlying data has changed.
version Required	str A version to assign to the step.
hash_paths Required	list DEPRECATED. A list of paths to hash when checking for changes to the pipeline step contents. By default, all files under the `path` parameter in AutoMLConfig are hashed except files listed in .amlignore or .gitignore under `path`. If there are no changes detected, the pipeline reuses the step contents from a previous run.
enable_default_model_output Required	bool Indicates whether or not the best model will be added as a default output. This can be used to retrieve the best model after the run has completed using the AutoMLStepRun class. Note, if the default model output is not required, it is recommended to set this parameter to `False`.
enable_default_metrics_output Required	bool Indicates whether or not all child run metrics will be added as a default output. This can be used to retrieve the child run metrics after the run has completed using the AutoMLStepRun class. Note, if the default metrics output is not required, it is recommended to set this parameter to `False`.

Remarks

With the AutoMLStep class you can run your automated ML workflow in an Azure Machine Learning pipeline. Pipelines provide benefits such as repeatability, unattended runs, versioning and tracking, and modularity for your automated ML workflow. For more informaton, see What are Azure Machine Learning pipelines?.

When your automated ML workflow is in a pipeline, you can schedule the pipeline to run on a time-based schedule or on a change-based schedule. Time-based schedules are useful for routine tasks such as monitoring data drift, while change-based schedules are useful for irregular or unpredictable changes such as when data changes. For example, your schedule might poll a blob store where the data is being uploaded and then run the pipeline again if data changes and then register new version of the model once the run is complete. For more information, see Schedule machine learning pipelines and Trigger a run of a Machine Learning pipeline from a Logic App.

The following example shows how to create an AutoMLStep.


   automl_step = AutoMLStep(
       name='automl_module',
       automl_config=automl_config,
       outputs=[metrics_data, model_data],
       allow_reuse=True)

Full sample is available from https://github.com/Azure/MachineLearningNotebooks/blob/master/how-to-use-azureml/machine-learning-pipelines/intro-to-pipelines/aml-pipelines-with-automated-machine-learning-step.ipynb

The following example show how to use the AutoMLStep object in a Pipeline.


   from azureml.pipeline.core import Pipeline
   pipeline = Pipeline(
       description="pipeline_with_automlstep",
       workspace=ws,
       steps=[automl_step])

The above example shows one step in the pipeline. However, when using AutoMLStep in a real-world automated ML workflow, you will have a least one pipeline step that performs data preparation before the AutoMLStep, and another pipeline step after that registers the model. For example of this type of workflow, see the notebook https://aka.ms/automl-retrain-pipeline.

To manage, check status, and get run details from the pipeline run, use the AutoMLStepRun class.

For more information about automated machine learning in Azure, see the article What is automated machine learning?. For more information about setting up an automated ML experiment without using a pipeline, see the article Configure automated ML experiment in Python.

Methods

create_node

Create a node from this AutoML step and add to the given graph.

This method is not intended to be used directly. When a pipeline is instantiated with this step, Azure ML automatically passes the parameters required through this method so that step can be added to a pipeline graph that represents the workflow.

create_node

Create a node from this AutoML step and add to the given graph.

create_node(graph, default_datastore, context)

Parameters

Name	Description
graph Required	Graph The graph object to add the node to.
default_datastore Required	Union[AbstractAzureStorageDatastore, AzureDataLakeDatastore] The default datastore.
context Required	<xref:azureml.pipeline.core._GraphContext> The graph context.

Returns

Type	Description
Node	The created node.

Attributes

AUTOML_CONFIG_PARAM_NAME

AUTOML_CONFIG_PARAM_NAME = 'AutoMLConfig'

DEFAULT_METRIC_PREFIX

DEFAULT_METRIC_PREFIX = 'default_metrics_'

DEFAULT_MODEL_PREFIX

DEFAULT_MODEL_PREFIX = 'default_model_'

Share via

AutoMLStep Class

Constructor

Parameters

Remarks

Methods

create_node

Parameters

Returns

Attributes

AUTOML_CONFIG_PARAM_NAME

DEFAULT_METRIC_PREFIX

DEFAULT_MODEL_PREFIX

Feedback

Additional resources