Query about classifier confidence

Question

Can I look at the confidence breakdown across all class labels in my Azure Document Intelligence custom classifier.

For example, if my classifier has 3 class labels:

1- Tax Return Form

2- Lease Agreement

3- Unknown forms

What I mean by the confidence breakdown is that if I give my model a new form after it was trained on the provided 3 class labels, it would give me the confidence of the form being in each of those 3 labels.

Answer 1

Hi Muhammad Maaz,
Greetings & Welcome to Microsoft Q&A forum! Thanks for posting your query!

Yes, you can look at the confidence breakdown across all class labels in your Azure Document Intelligence custom classifier. When you provide a new form to your trained model, it will output the confidence scores for each of the class labels you have defined.

For example, if your classifier has the following class labels:

1. Tax Return Form
2. Lease Agreement
3. Unknown forms

When you input a new form, the model will give you the confidence scores for each of these labels. This means you will get a confidence score indicating how likely the form is to be a Tax Return Form, a Lease Agreement, or an Unknown form. These scores can help you understand the model's certainty in its classification and make informed decisions based on that information.

Hope this helps. Do let us know if you have any further queries.

---

If this answers your query, do click Accept Answer and Yes for was this answer helpful.