Iterations - Get Performance

Service:

Azure AI Services

API Version:

3.3

Get detailed performance information about an iteration.

GET {Endpoint}/customvision/v3.3/training/projects/{projectId}/iterations/{iterationId}/performance

With optional parameters:

GET {Endpoint}/customvision/v3.3/training/projects/{projectId}/iterations/{iterationId}/performance?threshold={threshold}&overlapThreshold={overlapThreshold}

URI Parameters

Name	In	Required	Type	Description
Endpoint	path	True	string	Supported Cognitive Services endpoints.
iterationId	path	True	string uuid	The id of the iteration to get.
projectId	path	True	string uuid	The id of the project the iteration belongs to.
overlapThreshold	query		number float	If applicable, the bounding box overlap threshold used to determine true predictions.
threshold	query		number float	The threshold used to determine true predictions.

Request Header

Name	Required	Type	Description
Training-Key	True	string

Responses

Name	Type	Description
200 OK	IterationPerformance	OK Media Types: "application/json", "application/xml", "text/xml"
Other Status Codes	CustomVisionError	Error response Media Types: "application/json", "application/xml", "text/xml"

Security

Training-Key

Type: apiKey
In: header

Examples

Successful GetIterationPerformance request

Sample request

HTTP

GET https://westus.api.cognitive.microsoft.com/customvision/v3.3/training/projects/bc3f7dad-5544-468c-8573-3ef04d55463e/iterations/fe1e83c4-6f50-4899-9544-6bb08cf0e15a/performance?threshold=0.9

Sample response

Status code:

200

{
  "perTagPerformance": [
    {
      "id": "e31ff107-5505-4753-be42-b369b21b026c",
      "name": "Hemlock",
      "precision": 1,
      "precisionStdDeviation": 0,
      "recall": 1,
      "recallStdDeviation": 0
    },
    {
      "id": "349d72ac-0948-4d51-b1e4-c14a1f9b848a",
      "name": "Japanese Cherry",
      "precision": 1,
      "precisionStdDeviation": 0,
      "recall": 1,
      "recallStdDeviation": 0
    }
  ],
  "precision": 1,
  "precisionStdDeviation": 0,
  "recall": 1,
  "recallStdDeviation": 0
}

Definitions

Name	Description
CustomVisionError
CustomVisionErrorCodes	The error code.
IterationPerformance	Represents the detailed performance data for a trained iteration.
TagPerformance	Represents performance data for a particular tag in a trained iteration.

CustomVisionError

Object

Name	Type	Description
code	CustomVisionErrorCodes	The error code.
message	string	A message explaining the error reported by the service.

CustomVisionErrorCodes

Enumeration

The error code.

Value	Description
BadRequest
BadRequestCannotMigrateProjectWithName
BadRequestClassificationTrainingValidationFailed
BadRequestCustomerManagedKeyRevoked
BadRequestDetectionTrainingNotAllowNegativeTag
BadRequestDetectionTrainingValidationFailed
BadRequestDomainNotSupportedForAdvancedTraining
BadRequestExceedIterationPerProjectLimit
BadRequestExceedProjectLimit
BadRequestExceedTagPerImageLimit
BadRequestExceedTagPerProjectLimit
BadRequestExceededBatchSize
BadRequestExceededQuota
BadRequestExportAlreadyInProgress
BadRequestExportPlatformNotSupportedForAdvancedTraining
BadRequestExportValidationFailed
BadRequestExportWhileTraining
BadRequestImageBatch
BadRequestImageDimensions
BadRequestImageExceededCount
BadRequestImageFormat
BadRequestImageMetadataKey
BadRequestImageMetadataValue
BadRequestImageRegions
BadRequestImageSizeBytes
BadRequestImageStream
BadRequestImageTags
BadRequestImageUrl
BadRequestInvalid
BadRequestInvalidArtifactUri
BadRequestInvalidEmailAddress
BadRequestInvalidIds
BadRequestInvalidImportToken
BadRequestInvalidPublishName
BadRequestInvalidPublishTarget
BadRequestIterationDescription
BadRequestIterationIsNotTrained
BadRequestIterationIsPublished
BadRequestIterationName
BadRequestIterationNameNotUnique
BadRequestIterationNotPublished
BadRequestIterationValidationFailed
BadRequestMultiClassClassificationTrainingValidationFailed
BadRequestMultiLabelClassificationTrainingValidationFailed
BadRequestMultipleGeneralProductTag
BadRequestMultipleNegativeTag
BadRequestNegativeAndRegularTagOnSameImage
BadRequestNotLimitedTrial
BadRequestNotSupported
BadRequestOperationNotSupported
BadRequestPredictionIdsExceededCount
BadRequestPredictionIdsMissing
BadRequestPredictionInvalidApplicationName
BadRequestPredictionInvalidQueryParameters
BadRequestPredictionResultsExceededCount
BadRequestPredictionTagsExceededCount
BadRequestProjectDescription
BadRequestProjectDuplicated
BadRequestProjectImagePreprocessingSettings
BadRequestProjectName
BadRequestProjectNameNotUnique
BadRequestProjectUnknownClassification
BadRequestProjectUnknownDomain
BadRequestProjectUnsupportedDomainTypeChange
BadRequestProjectUnsupportedExportPlatform
BadRequestRequiredParamIsNull
BadRequestReservedBudgetInHoursNotEnoughForAdvancedTraining
BadRequestSubscriptionApi
BadRequestTagDescription
BadRequestTagName
BadRequestTagNameNotUnique
BadRequestTagType
BadRequestTrainingAlreadyInProgress
BadRequestTrainingNotNeeded
BadRequestTrainingNotNeededButTrainingPipelineUpdated
BadRequestTrainingValidationFailed
BadRequestUnpublishFailed
BadRequestUnsupportedDomain
BadRequestWorkspaceCannotBeModified
BadRequestWorkspaceNotDeletable
Conflict
ConflictInvalid
ErrorExporterInvalidClassifier
ErrorExporterInvalidFeaturizer
ErrorExporterInvalidPlatform
ErrorFeaturizationAugmentationError
ErrorFeaturizationAugmentationUnavailable
ErrorFeaturizationInvalidFeaturizer
ErrorFeaturizationQueueTimeout
ErrorFeaturizationServiceUnavailable
ErrorFeaturizationUnrecognizedJob
ErrorInvalid
ErrorIterationCopyFailed
ErrorPrediction
ErrorPredictionModelNotCached
ErrorPredictionModelNotFound
ErrorPredictionServiceUnavailable
ErrorPredictionStorage
ErrorPreparePerformanceMigrationFailed
ErrorProjectExportRequestFailed
ErrorProjectImportRequestFailed
ErrorProjectInvalidDomain
ErrorProjectInvalidPipelineConfiguration
ErrorProjectInvalidWorkspace
ErrorProjectTrainingRequestFailed
ErrorRegionProposal
ErrorUnknown
ErrorUnknownBaseModel
Forbidden
ForbiddenDRModeEnabled
ForbiddenInvalid
ForbiddenUser
ForbiddenUserDisabled
ForbiddenUserDoesNotExist
ForbiddenUserInsufficientCapability
ForbiddenUserResource
ForbiddenUserSignupAllowanceExceeded
ForbiddenUserSignupDisabled
NoError
NotFound
NotFoundApimSubscription
NotFoundDomain
NotFoundImage
NotFoundInvalid
NotFoundIteration
NotFoundIterationPerformance
NotFoundProject
NotFoundProjectDefaultIteration
NotFoundTag
UnsupportedMediaType

IterationPerformance

Object

Represents the detailed performance data for a trained iteration.

Name	Type	Description
averagePrecision	number	Gets the average precision when applicable.
perTagPerformance	TagPerformance[]	Gets the per-tag performance details for this iteration.
precision	number	Gets the precision.
precisionStdDeviation	number	Gets the standard deviation for the precision.
recall	number	Gets the recall.
recallStdDeviation	number	Gets the standard deviation for the recall.

TagPerformance

Object

Represents performance data for a particular tag in a trained iteration.

Name	Type	Description
averagePrecision	number	Gets the average precision when applicable.
id	string
name	string
precision	number	Gets the precision.
precisionStdDeviation	number	Gets the standard deviation for the precision.
recall	number	Gets the recall.
recallStdDeviation	number	Gets the standard deviation for the recall.