Microsoft.Extensions.AI.Evaluation Namespace

Reference

Important

Some information relates to prerelease product that may be substantially modified before it’s released. Microsoft makes no warranties, express or implied, with respect to the information provided here.

Classes

BooleanMetric	An EvaluationMetric containing a Boolean value that can be used to represent an outcome that can have one of two possible values.
ChatConfiguration	Specifies the IChatClient and the IEvaluationTokenCounter that should be used when evaluation is performed using an AI model.
CompositeEvaluator	An IEvaluator that composes other IEvaluators to execute multiple (concurrent) evaluations on a supplied response.
EvaluationContext	A base class that represents additional contextual information (beyond that which is available in the conversation history) that an IEvaluator may need to accurately evaluate a supplied response.
EvaluationDiagnostic	Represents a diagnostic (such as a warning, error or informational message) that applies to the result represented in an EvaluationMetric.
EvaluationMetric	A base class that represents the result of an evaluation.
EvaluationMetric<T>	An abstract base class that represents the result of an evaluation containing a value of type `T`.
EvaluationMetricExtensions	Extension methods for EvaluationMetric.
EvaluationMetricInterpretation	Specifies how the result represented in an associated EvaluationMetric should be interpreted.
EvaluationResult	A collection of one or more EvaluationMetrics that represent the result of an evaluation.
EvaluationResultExtensions	Extension methods for EvaluationResult.
EvaluatorExtensions	Extension methods for IEvaluator.
NumericMetric	An EvaluationMetric containing a numeric value.
StringMetric	An EvaluationMetric containing a String value.
TokenizerExtensions	Extension methods for Tokenizer.

Interfaces

IEvaluationTokenCounter	Counts the number of tokens present in evaluation prompts that are to be sent to an AI model.
IEvaluator	Evaluates responses produced by an AI model.

Enums

EvaluationDiagnosticSeverity	An enumeration that identifies the set of possible values for Severity.
EvaluationRating	An enumeration that identifies the set of possible ways in which an EvaluationMetric can be interpreted.