Jaa

CachingChatClient.WriteCacheStreamingAsync Method

  • Reference

Definition

Namespace:
Microsoft.Extensions.AI
Assembly:
Microsoft.Extensions.AI.dll
Package:
Microsoft.Extensions.AI v9.0.0-preview.9.24556.5

Stores a list of StreamingChatCompletionUpdate values in the underlying cache. This is used when there is a call to CompleteStreamingAsync(IList<ChatMessage>, ChatOptions, CancellationToken).

protected:
 abstract System::Threading::Tasks::Task ^ WriteCacheStreamingAsync(System::String ^ key, System::Collections::Generic::IReadOnlyList<Microsoft::Extensions::AI::StreamingChatCompletionUpdate ^> ^ value, System::Threading::CancellationToken cancellationToken);
protected abstract System.Threading.Tasks.Task WriteCacheStreamingAsync (string key, System.Collections.Generic.IReadOnlyList<Microsoft.Extensions.AI.StreamingChatCompletionUpdate> value, System.Threading.CancellationToken cancellationToken);
abstract member WriteCacheStreamingAsync : string * System.Collections.Generic.IReadOnlyList<Microsoft.Extensions.AI.StreamingChatCompletionUpdate> * System.Threading.CancellationToken -> System.Threading.Tasks.Task
Protected MustOverride Function WriteCacheStreamingAsync (key As String, value As IReadOnlyList(Of StreamingChatCompletionUpdate), cancellationToken As CancellationToken) As Task

Parameters

key
String

The cache key.

value
IReadOnlyList<StreamingChatCompletionUpdate>

The ChatCompletion to be stored.

cancellationToken
CancellationToken

The CancellationToken to monitor for cancellation requests.

Returns

Task

A Task representing the completion of the operation.

Applies to