Jaa


DistributedCachingChatClient.ReadCacheStreamingAsync Method

Definition

Returns a previously cached list of StreamingChatCompletionUpdate values, if available. This is used when there is a call to CompleteStreamingAsync(IList<ChatMessage>, ChatOptions, CancellationToken).

protected:
 override System::Threading::Tasks::Task<System::Collections::Generic::IReadOnlyList<Microsoft::Extensions::AI::StreamingChatCompletionUpdate ^> ^> ^ ReadCacheStreamingAsync(System::String ^ key, System::Threading::CancellationToken cancellationToken);
protected override System.Threading.Tasks.Task<System.Collections.Generic.IReadOnlyList<Microsoft.Extensions.AI.StreamingChatCompletionUpdate>?> ReadCacheStreamingAsync (string key, System.Threading.CancellationToken cancellationToken);
override this.ReadCacheStreamingAsync : string * System.Threading.CancellationToken -> System.Threading.Tasks.Task<System.Collections.Generic.IReadOnlyList<Microsoft.Extensions.AI.StreamingChatCompletionUpdate>>
Protected Overrides Function ReadCacheStreamingAsync (key As String, cancellationToken As CancellationToken) As Task(Of IReadOnlyList(Of StreamingChatCompletionUpdate))

Parameters

key
String

The cache key.

cancellationToken
CancellationToken

The CancellationToken to monitor for cancellation requests.

Returns

The previously cached data, if available, otherwise null.

Applies to