ChatOptions.TopK Property

Definition

Namespace:

Microsoft.Extensions.AI

Assembly:

Microsoft.Extensions.AI.Abstractions.dll

Package:

Microsoft.Extensions.AI.Abstractions v9.3.0-preview.1.25114.11

Source:

ChatOptions.cs

Gets or sets the number of most probable tokens that the model considers when generating the next part of the text.

public:
 property Nullable<int> TopK { Nullable<int> get(); void set(Nullable<int> value); };

public int? TopK { get; set; }

member this.TopK : Nullable<int> with get, set

Public Property TopK As Nullable(Of Integer)

Property Value

Nullable<Int32>

Remarks

This property reduces the probability of generating nonsense. A higher value gives more diverse answers, while a lower value is more conservative.