Jaa


CachingChatClient.ReadCacheStreamingAsync(String, CancellationToken) Method

Definition

Returns a previously cached list of StreamingChatCompletionUpdate values, if available. This is used when there is a call to CompleteStreamingAsync(IList<ChatMessage>, ChatOptions, CancellationToken).

protected:
 abstract System::Threading::Tasks::Task<System::Collections::Generic::IReadOnlyList<Microsoft::Extensions::AI::StreamingChatCompletionUpdate ^> ^> ^ ReadCacheStreamingAsync(System::String ^ key, System::Threading::CancellationToken cancellationToken);
protected abstract System.Threading.Tasks.Task<System.Collections.Generic.IReadOnlyList<Microsoft.Extensions.AI.StreamingChatCompletionUpdate>?> ReadCacheStreamingAsync (string key, System.Threading.CancellationToken cancellationToken);
abstract member ReadCacheStreamingAsync : string * System.Threading.CancellationToken -> System.Threading.Tasks.Task<System.Collections.Generic.IReadOnlyList<Microsoft.Extensions.AI.StreamingChatCompletionUpdate>>
Protected MustOverride Function ReadCacheStreamingAsync (key As String, cancellationToken As CancellationToken) As Task(Of IReadOnlyList(Of StreamingChatCompletionUpdate))

Parameters

key
String

The cache key.

cancellationToken
CancellationToken

The CancellationToken to monitor for cancellation requests.

Returns

The previously cached data, if available, otherwise null.

Applies to