DistributedCachingChatClient.WriteCacheStreamingAsync Method

Definition

Namespace:

Microsoft.Extensions.AI

Assembly:

Microsoft.Extensions.AI.dll

Package:

Microsoft.Extensions.AI v9.0.0-preview.9.24556.5

Stores a list of StreamingChatCompletionUpdate values in the underlying cache. This is used when there is a call to CompleteStreamingAsync(IList<ChatMessage>, ChatOptions, CancellationToken).

protected:
 override System::Threading::Tasks::Task ^ WriteCacheStreamingAsync(System::String ^ key, System::Collections::Generic::IReadOnlyList<Microsoft::Extensions::AI::StreamingChatCompletionUpdate ^> ^ value, System::Threading::CancellationToken cancellationToken);

protected override System.Threading.Tasks.Task WriteCacheStreamingAsync (string key, System.Collections.Generic.IReadOnlyList<Microsoft.Extensions.AI.StreamingChatCompletionUpdate> value, System.Threading.CancellationToken cancellationToken);

override this.WriteCacheStreamingAsync : string * System.Collections.Generic.IReadOnlyList<Microsoft.Extensions.AI.StreamingChatCompletionUpdate> * System.Threading.CancellationToken -> System.Threading.Tasks.Task

Protected Overrides Function WriteCacheStreamingAsync (key As String, value As IReadOnlyList(Of StreamingChatCompletionUpdate), cancellationToken As CancellationToken) As Task

Parameters

key

String

The cache key.

value

IReadOnlyList<StreamingChatCompletionUpdate>

The ChatCompletion to be stored.

cancellationToken

CancellationToken

The CancellationToken to monitor for cancellation requests.

Returns

Task

A Task representing the completion of the operation.