ChatConversationEvaluator Class

Definition

Namespace:

Microsoft.Extensions.AI.Evaluation.Quality

Assembly:

Microsoft.Extensions.AI.Evaluation.Quality.dll

Package:

Microsoft.Extensions.AI.Evaluation.Quality v0.9.56-preview

An abstract base class that can be used to implement an AI-based IEvaluator.

public ref class ChatConversationEvaluator abstract : Microsoft::Extensions::AI::Evaluation::IEvaluator

public abstract class ChatConversationEvaluator : Microsoft.Extensions.AI.Evaluation.IEvaluator

type ChatConversationEvaluator = class
    interface IEvaluator

Public MustInherit Class ChatConversationEvaluator
Implements IEvaluator

Inheritance

Object

ChatConversationEvaluator

Derived

Microsoft.Extensions.AI.Evaluation.Quality.RelevanceTruthAndCompletenessEvaluator

Microsoft.Extensions.AI.Evaluation.Quality.SingleNumericMetricEvaluator

Implements

IEvaluator

Constructors

ChatConversationEvaluator()

Properties

ChatOptions	Gets the ChatOptions that this IEvaluator uses when performing evaluations.
EvaluationMetricNames	Identifies the Names of the EvaluationMetrics produced by this IEvaluator.
IgnoresHistory	Gets a value that indicates whether this IEvaluator considers the entire conversation history (in addition to the request and response being evaluated) as part of the evaluation it performs.
SystemPrompt	Gets the system prompt that this IEvaluator uses when performing evaluations.

Methods

CanRenderAsync(ChatMessage, Int32, ChatConfiguration, CancellationToken)	Determines if there is sufficient tokenBudget remaining to render the supplied message as part of the evaluation prompt that this IEvaluator uses.
Equals(Object)	Determines whether the specified object is equal to the current object. (Inherited from Object)
EvaluateAsync(IEnumerable<ChatMessage>, ChatMessage, ChatConfiguration, IEnumerable<EvaluationContext>, CancellationToken)	Evaluates the supplied modelResponse and returns an EvaluationResult containing one or more EvaluationMetrics.
GetHashCode()	Serves as the default hash function. (Inherited from Object)
GetType()	Gets the Type of the current instance. (Inherited from Object)
InitializeResult()	Returns an EvaluationResult that includes default values for all the EvaluationMetrics supported by this IEvaluator.
MemberwiseClone()	Creates a shallow copy of the current Object. (Inherited from Object)
ParseEvaluationResponseAsync(String, EvaluationResult, ChatConfiguration, CancellationToken)	Parses the evaluation result present in modelResponseForEvaluationPrompt into the EvaluationMetrics present in the supplied result.
RenderAsync(ChatMessage, CancellationToken)	Renders the supplied message to a string that can be included as part of the evaluation prompt that this IEvaluator uses.
RenderEvaluationPromptAsync(ChatMessage, ChatMessage, IEnumerable<ChatMessage>, IEnumerable<EvaluationContext>, CancellationToken)	Renders the information present in the supplied parameters into a prompt that this IEvaluator uses to perform the evaluation.
ToString()	Returns a string that represents the current object. (Inherited from Object)

Extension Methods

EvaluateAsync(IEvaluator, ChatMessage, ChatMessage, ChatConfiguration, IEnumerable<EvaluationContext>, CancellationToken)	Evaluates the supplied modelResponse and returns an EvaluationResult containing one or more EvaluationMetrics.
EvaluateAsync(IEvaluator, ChatMessage, ChatConfiguration, IEnumerable<EvaluationContext>, CancellationToken)	Evaluates the supplied modelResponse and returns an EvaluationResult containing one or more EvaluationMetrics.
EvaluateAsync(IEvaluator, String, ChatConfiguration, IEnumerable<EvaluationContext>, CancellationToken)	Evaluates the supplied modelResponse and returns an EvaluationResult containing one or more EvaluationMetrics.
EvaluateAsync(IEvaluator, String, String, ChatConfiguration, IEnumerable<EvaluationContext>, CancellationToken)	Evaluates the supplied modelResponse and returns an EvaluationResult containing one or more EvaluationMetrics.