CDC support for Azure PostgreSQL flexible server

Question

Hi,

The current ADF do not support Azure PostgreSQL flexible server under Change Data Capture. I this going to be supported in future ? If why when can it be expected ?

Answer 1

Hi ,

Thanks for reaching out to Microsoft Q&A.

As of now, ADF's CDC feature does not support Azure Database for PostgreSQL Flexible Server as a source. The current list of supported data sources includes Azure SQL Database, Azure SQL Managed Instance, SQL Server, Azure Cosmos DB (SQL API), and various file formats such as Avro, Delimited Text, JSON, ORC, Parquet, XML, and Snowflake.

https://learn.microsoft.com/en-us/azure/data-factory/concepts-change-data-capture-resource?utm_source=chatgpt.com

Microsoft has not publicly announced plans or timelines to extend CDC support to Azure Database for PostgreSQL Flexible Server. For the most current information, it's advisable to monitor Azure Data Factory's official documentation and release notes.

In the meantime, to implement CDC with Azure Database for PostgreSQL Flexible Server, you might consider using PostgreSQL's native logical decoding feature in conjunction with tools like wal2json to stream changes. This approach involves configuring logical replication slots and can be integrated with Azure services for data processing.

Alternatively, you can design custom ETL processes within Azure Data Factory to handle incremental data loads from PostgreSQL, though this may require additional development effort.

Please feel free to click the 'Upvote' (Thumbs-up) button and 'Accept as Answer'. This helps the community by allowing others with similar queries to easily find the solution.