Jaa


CachingChatClient.ReadCacheAsync(String, CancellationToken) Method

Definition

Returns a previously cached ChatCompletion, if available. This is used when there is a call to CompleteAsync(IList<ChatMessage>, ChatOptions, CancellationToken).

protected:
 abstract System::Threading::Tasks::Task<Microsoft::Extensions::AI::ChatCompletion ^> ^ ReadCacheAsync(System::String ^ key, System::Threading::CancellationToken cancellationToken);
protected abstract System.Threading.Tasks.Task<Microsoft.Extensions.AI.ChatCompletion?> ReadCacheAsync (string key, System.Threading.CancellationToken cancellationToken);
abstract member ReadCacheAsync : string * System.Threading.CancellationToken -> System.Threading.Tasks.Task<Microsoft.Extensions.AI.ChatCompletion>
Protected MustOverride Function ReadCacheAsync (key As String, cancellationToken As CancellationToken) As Task(Of ChatCompletion)

Parameters

key
String

The cache key.

cancellationToken
CancellationToken

The CancellationToken to monitor for cancellation requests.

Returns

The previously cached data, if available, otherwise null.

Applies to