DiskBasedResponseCache Class

Reference

Definition

Namespace:: Microsoft.Extensions.AI.Evaluation.Reporting.Storage.Disk

Assembly:: Microsoft.Extensions.AI.Evaluation.Reporting.dll

Package:: Microsoft.Extensions.AI.Evaluation.Reporting v0.9.56-preview

Important

Some information relates to prerelease product that may be substantially modified before it’s released. Microsoft makes no warranties, express or implied, with respect to the information provided here.

An IDistributedCache implementation that stores cached AI responses for a particular ScenarioRun on disk.

public ref class DiskBasedResponseCache sealed : Microsoft::Extensions::Caching::Distributed::IDistributedCache

public sealed class DiskBasedResponseCache : Microsoft.Extensions.Caching.Distributed.IDistributedCache

type DiskBasedResponseCache = class
    interface IDistributedCache

Public NotInheritable Class DiskBasedResponseCache
Implements IDistributedCache

Inheritance: Object
DiskBasedResponseCache

Implements: IDistributedCache

Remarks

DiskBasedResponseCache can be used in conjunction with ResponseCachingChatClient to implement disk-based caching of all AI responses that happen as part of an evaluation run.

Constructors

DiskBasedResponseCache(String, String, String)

Creates a new DiskBasedResponseCache instance.

Methods

Get(String)	Gets a value with the given key.
GetAsync(String, CancellationToken)	Gets a value with the given key.
Refresh(String)	Refreshes a value in the cache based on its key, resetting its sliding expiration timeout (if any).
RefreshAsync(String, CancellationToken)	Refreshes a value in the cache based on its key, resetting its sliding expiration timeout (if any).
Remove(String)	Removes the value with the given key.
RemoveAsync(String, CancellationToken)	Removes the value with the given key.
Set(String, Byte[], DistributedCacheEntryOptions)	Sets a value with the given key.
SetAsync(String, Byte[], DistributedCacheEntryOptions, CancellationToken)	Sets the value with the given key.

Extension Methods

GetString(IDistributedCache, String)	Gets a string from the specified cache with the specified key.
GetStringAsync(IDistributedCache, String, CancellationToken)	Asynchronously gets a string from the specified cache with the specified key.
Set(IDistributedCache, String, Byte[])	Sets a sequence of bytes in the specified cache with the specified key.
SetAsync(IDistributedCache, String, Byte[], CancellationToken)	Asynchronously sets a sequence of bytes in the specified cache with the specified key.
SetString(IDistributedCache, String, String, DistributedCacheEntryOptions)	Sets a string in the specified cache with the specified key.
SetString(IDistributedCache, String, String)	Sets a string in the specified cache with the specified key.
SetStringAsync(IDistributedCache, String, String, DistributedCacheEntryOptions, CancellationToken)	Asynchronously sets a string in the specified cache with the specified key.
SetStringAsync(IDistributedCache, String, String, CancellationToken)	Asynchronously sets a string in the specified cache with the specified key.

Applies to

Del via