Dela via

ChatOptions.TopP Property

  • Reference

Definition

Namespace:
Microsoft.Extensions.AI
Assembly:
Microsoft.Extensions.AI.Abstractions.dll
Package:
Microsoft.Extensions.AI.Abstractions v9.3.0-preview.1.25114.11
Source:
ChatOptions.cs

Gets or sets the "nucleus sampling" factor (or "top p") for generating chat responses.

public:
 property Nullable<float> TopP { Nullable<float> get(); void set(Nullable<float> value); };
public float? TopP { get; set; }
member this.TopP : Nullable<single> with get, set
Public Property TopP As Nullable(Of Single)

Property Value

Nullable<Single>

Remarks

Nucleus sampling is an alternative to sampling with temperature where the model considers the results of the tokens with TopP probability mass. For example, 0.1 means only the tokens comprising the top 10% probability mass are considered.

Applies to