Dela via


Agent.TopP Property

Definition

An alternative to sampling with temperature, called nucleus sampling, where the model considers the results of the tokens with top_p probability mass. So 0.1 means only the tokens comprising the top 10% probability mass are considered.

We generally recommend altering this or temperature but not both.

public float? TopP { get; }
member this.TopP : Nullable<single>
Public ReadOnly Property TopP As Nullable(Of Single)

Property Value

Applies to