Share via

HuggingFacePromptExecutionSettings.WaitForModel Property

  • Reference

Definition

Namespace:
Microsoft.SemanticKernel.Connectors.HuggingFace
Assembly:
Microsoft.SemanticKernel.Connectors.HuggingFace.dll
Package:
Microsoft.SemanticKernel.Connectors.HuggingFace v1.20.0-preview

(Default: false) Boolean. If the model is not ready, wait for it instead of receiving 503. It limits the number of requests required to get your inference done. It is advised to only set this flag to true after receiving a 503 error as it will limit hanging in your application to known places.

[System.Text.Json.Serialization.JsonPropertyName("wait_for_model")]
public bool WaitForModel { get; set; }
[<System.Text.Json.Serialization.JsonPropertyName("wait_for_model")>]
member this.WaitForModel : bool with get, set
Public Property WaitForModel As Boolean

Property Value

Boolean
Attributes
JsonPropertyNameAttribute

Remarks

This may not be supported by all models/inference API.

Applies to