Issue with Video Indexer Identifying Different People as the Same

Question

We have noticed that Video Indexer is identifying different people as the same person.

As seen in the screenshot below, the faces marked do not belong to UnknownPerson105. This is a direct screenshot from the Video Indexer interface itself.

Could you please look into this issue and provide a possible solution? Looking forward to your response.

Answer 1

Hi eMAM IT,
Greetings & Welcome to the Microsoft Q&A forum! Thank you for sharing your query. 

It looks like Azure Video Indexer is misidentifying different people as the same individual in its facial recognition results. This could be due to model limitations, low-quality frames, or similarities in facial features under certain conditions. Here are some steps to improve accuracy:

• Use the Insights tab in Video Indexer to manually separate wrongly identified faces.
• Analyze the JSON insights and adjust the threshold to exclude low-confidence matches.
• Manually add more diverse and clear images of the correct individuals if you have access.
• Ensure the input video meets the recommended criteria (e.g., 30 FPS, proper lighting, and avoiding too many people per frame).
• Ensure the detected individuals appear in the frame with a clear, unobstructed view of their face and clothing.

For more information: Get observed people detection and matched faces insights

I hope this information helps.