Sdílet prostřednictvím

TritonInferencingServer Class

  • Reference

Note

This is an experimental class, and may change at any time. Please see https://aka.ms/azuremlexperimental for more information.

Azure ML triton inferencing configurations.

Inheritance
builtins.object
TritonInferencingServer

Constructor

TritonInferencingServer(*, inference_configuration: CodeConfiguration | None = None, **kwargs: Any)

Parameters

Name Description
inference_configuration
Required
CodeConfiguration

The inference configuration of the inferencing server.

Variables

Name Description
type

The type of the inferencing server.