Share via


OnlineRequestSettings Class

Definition

Online deployment scoring requests configuration.

[System.ComponentModel.TypeConverter(typeof(Microsoft.Azure.PowerShell.Cmdlets.MachineLearningServices.Models.Api20240401.OnlineRequestSettingsTypeConverter))]
public class OnlineRequestSettings : Microsoft.Azure.PowerShell.Cmdlets.MachineLearningServices.Models.Api20240401.IOnlineRequestSettings
[<System.ComponentModel.TypeConverter(typeof(Microsoft.Azure.PowerShell.Cmdlets.MachineLearningServices.Models.Api20240401.OnlineRequestSettingsTypeConverter))>]
type OnlineRequestSettings = class
    interface IOnlineRequestSettings
    interface IJsonSerializable
Public Class OnlineRequestSettings
Implements IOnlineRequestSettings
Inheritance
OnlineRequestSettings
Attributes
Implements

Constructors

OnlineRequestSettings()

Creates an new OnlineRequestSettings instance.

Properties

MaxConcurrentRequestsPerInstance

The number of maximum concurrent requests per node allowed per deployment. Defaults to 1.

MaxQueueWait

(Deprecated for Managed Online Endpoints) The maximum amount of time a request will stay in the queue in ISO 8601 format. Defaults to 500ms. (Now increase request_timeout_ms to account for any networking/queue delays)

RequestTimeout

The scoring timeout in ISO 8601 format. Defaults to 5000ms.

Methods

DeserializeFromDictionary(IDictionary)

Deserializes a IDictionary into an instance of OnlineRequestSettings.

DeserializeFromPSObject(PSObject)

Deserializes a PSObject into an instance of OnlineRequestSettings.

FromJson(JsonNode)

Deserializes a JsonNode into an instance of Microsoft.Azure.PowerShell.Cmdlets.MachineLearningServices.Models.Api20240401.IOnlineRequestSettings.

FromJsonString(String)

Creates a new instance of OnlineRequestSettings, deserializing the content from a json string.

ToJson(JsonObject, SerializationMode)

Serializes this instance of OnlineRequestSettings into a JsonNode.

ToJsonString()

Serializes this instance to a json string.

ToString()

Applies to