Create an indexer for Azure Search service index from blob storage (Json Array data) with Native blob soft delete

A_PONNAP 0 Reputation points
2024-12-16T02:13:42.24+00:00

Hi There,

We are building a public facing website using Azure Search Service to look up for data.

Our data is in CRM and we use power automate to copy day into azure storage table. And a scheduled indexer to feed data into the Search Index. However, it doesn't support document deletion.

As per the documentation there are two ways to deal with document deletion.

  1. Native blob soft delete (preview), applies to Blob Storage only
  2. Soft delete using custom metadata

We cannot go with the second approach because our Power Automate workflow runs every 24hrs, deletes all the entries from azure storage table inserts data again.

We are trying the first approach. However, when creating an indexer it throws error saying "This indexer uses 'NativeBlobSoftDeleteDetectionPolicy' which is not compatible with one-to-many parsing mode. Use a different type of deletion detection policy"
Data stored in blob is of Json Array format. Ex: [{"id": ""something", "name": "name1"}]

How do we fix this?

Regards,

Prasanth.

Azure AI Search
Azure AI Search
An Azure search service with built-in artificial intelligence capabilities that enrich information to help identify and explore relevant content at scale.
1,118 questions
Azure Blob Storage
Azure Blob Storage
An Azure service that stores unstructured data in the cloud as blobs.
3,002 questions
0 comments No comments
{count} votes

1 answer

Sort by: Most helpful
  1. Azar 24,365 Reputation points MVP
    2024-12-16T10:38:47.1566667+00:00

    Hi there A_PONNAP

    Thanks for using QandA platform

    Try adjusting your indexing setup. 'NativeBlobSoftDeleteDetectionPolicy' is incompatible with one-to-many parsing mode, this is used when processing multiple documents within a single blob, like your JSON . either store each document as an individual blob or switch to Batch parsing mode in your indexer, allowing multiple documents within a blob to be processed.

    If this helps kindly accept the answer thanks much.

    0 comments No comments

Your answer

Answers can be marked as Accepted Answers by the question author, which helps users to know the answer solved the author's problem.