HuggingFacePromptExecutionSettings.TopK Property

Definition

(Default: None). Integer to define the top tokens considered within the sample operation to create new text.

[System.Text.Json.Serialization.JsonPropertyName("top_k")]
public int? TopK { get; set; }
[<System.Text.Json.Serialization.JsonPropertyName("top_k")>]
member this.TopK : Nullable<int> with get, set
Public Property TopK As Nullable(Of Integer)

Property Value

Attributes

Remarks

This may not be supported by all models/inference API.

Applies to