Partager via

OnnxRuntimeGenAIPromptExecutionSettings.PastPresentShareBuffer Property

  • Reference

Definition

Namespace:
Microsoft.SemanticKernel.Connectors.Onnx
Assembly:
Microsoft.SemanticKernel.Connectors.Onnx.dll
Package:
Microsoft.SemanticKernel.Connectors.Onnx v1.20.0-alpha

The past/present kv tensors are shared and allocated once to max_length (cuda only)

[System.Text.Json.Serialization.JsonPropertyName("past_present_share_buffer")]
public bool? PastPresentShareBuffer { get; set; }
[<System.Text.Json.Serialization.JsonPropertyName("past_present_share_buffer")>]
member this.PastPresentShareBuffer : Nullable<bool> with get, set
Public Property PastPresentShareBuffer As Nullable(Of Boolean)

Property Value

Nullable<Boolean>
Attributes
JsonPropertyNameAttribute

Applies to