Replication, Change Tracking, Change Data Capture, and AlwaysOn Availability Groups (SQL Server)

SQL Server Replication, change data capture (CDC), and change tracking (CT) are supported on AlwaysOn Availability Groups. AlwaysOn Availability Groups helps provide high availability and additional database recovery capabilities.

In this Topic:

• Overview of Replication on AlwaysOn Availability Groups

  • Publisher Redirection

  • Changes to Replication Agents to Support AlwaysOn Availability Groups

  • Stored Procedures Supporting AlwaysOn

  • Change Data Capture

  • Change Tracking

• Prerequisites, Restrictions, and Considerations for Using Replication with AlwaysOn Availability Groups

• Related Tasks

Overview of Replication on AlwaysOn Availability Groups

Publisher Redirection

When a published database is aware of AlwaysOn Availability Groups, the distributor that provides agent access to the publishing database is configured with redirected_publishers entries. These entries redirect the originally configured publisher/database pair, making use of an availability group listener name to connect to the publisher and publishing database. Established connections through the availability group listener name will fail on failover. When the replication agent restarts after failover, the connection will automatically be redirected to the new primary.

In an AlwaysOn availability group a secondary database cannot be a publisher. Republishing is not supported when replication is combined with AlwaysOn Availability Groups.

If a published database is a member of an availability group and the publisher is redirected, it must be redirected to an availability group listener name associated with the availability group. It may not be redirected to an explicit node.

Note

After failover to a secondary replica, Replication Monitor is unable to adjust the name of the publishing instance of SQL Server and will continue to display replication information under the name of the original primary instance of SQL Server. After failover, a tracer token cannot be entered by using the Replication Monitor, however a tracer token entered on the new publisher by using Transact-SQL, is visible in Replication Monitor.

(top)

General Changes to Replication Agents to Support AlwaysOn Availability Groups

Three replication agents were modified to support AlwaysOn Availability Groups. The Log Reader, Snapshot, and Merge agents were modified to query the distribution database for the redirected publisher and to use the returned availability group listener name, if a redirected publisher was declared, to connect to the database publisher.

By default, when the agents query the distributor to determine whether the original publisher has been redirected, the suitability of the current target or redirection will be verified prior to returning the redirected host to the agent. This is recommended behavior. However, if agent start up occurs very frequently the overhead associated with the validation stored procedure may be deemed too costly. A new command line switch, BypassPublisherValidation, has been added to the Logreader, Snapshot, and Merge agents. When the switch is used, the redirected publisher is returned immediately to the agent and execution of the validation stored procedure is bypassed.

Failures returned from the validation stored procedure are logged in the agent history logs. Those errors with severity greater than or equal to 16 will cause the agents to terminate. Some retry capabilities have been built in to the agents to handle the expected disconnect from a published database when it fails over to a new primary.

(top)

Log Reader Agent Modifications

The Logreader Agent has the following changes.

• Replicated Database Consistency

  When a published database is a member of an AlwaysOn availability group, by default the log reader will not process log records that have not already been hardened at all availability group secondary replicas. This insures that on failover, all rows replicated to a subscriber also are present at the new primary.

  When the publisher has only two AlwaysOn availability replicas (one primary and one secondary) and a failover happens, the original primary replica remains down because the logreader does not move forward until all secondary databases are brought back online or until the failing secondary replicas are removed from the availability group. The logreader, now running against the secondary database, will not proceed forward since AlwaysOn cannot harden any changes to any secondary database. To allow the logreader to proceed further and still have disaster recovery capacity, remove the original primary replica from the availability group using ALTER AVAILABITY GROUP <group_name> REMOVE REPLICA. Then add a new secondary replica to the availability group.

• Trace flag 1448

  Trace flag 1448 enables the replication log reader to move forward even if the asynchronous secondary replicas have not acknowledged the reception of a change. Even with this trace flag enabled,, the log reader always waits for the synchronous secondary replicas. The log reader will not go beyond the min ack of the synchronous secondary replicas. This trace flag applies to the instance of SQL Server, not just to an availability group, an availability database, or a log reader instance. This trace flag takes effect immediately without a restart. It can be activated ahead of time or when an asynchronous secondary replica fails.

(top)

Stored Procedures Supporting AlwaysOn

• sp_redirect_publisher

  The stored procedure sp_redirect_publisher is used to specify a redirected publisher for an existing publisher/database pair. If the publisher database belongs to an availability group, the redirected publisher is the availability group listener name.

• sp_get_redirected_publisher

  The stored procedure sp_get_redirected_publisher is used by replication agents to query a distributor to determine whether a publisher/database pair has a defined redirected publisher. This stored procedure serves two purposes. First, it allows the agent to determine whether the original publisher has been redirected. Second, it may also initiate a validation stored procedure run at the distributor (sp_validate_redirected_publisher) that verifies the suitability of the target node of the redirection to serve as a publisher for the named database.

  To execute this stored procedure the caller must either be a member of the sysadmin server role, the db_owner database role for the distribution database, or a member of a Publication Access List for a defined publication associated with the publisher database.

• sp_validate_redirected_publisher

  This stored procedure attempts to validate that the current publisher is capable of hosting the published database. It can be called at any time to verify that the current host for the published database is capable of supporting replication.

• sp_validate_replicate_hosts_as_publishers

  While it is useful for the agents to insure that the current primary can function as the replication publisher for a publisher database, a more general validation capability is needed to establish the validity of an entire replication topology on an AlwaysOn availability database. The stored procedure sp_validate_replica_hosts_as_publishers is designed to fill this need.

  This stored procedure is always run manually. The caller must either be sysadmin at the distributor, dbowner of the distribution database, or a member of the Publication Access List of a publication of the publisher database. In addition, the login of the caller must be a valid login for all of the availability replica hosts, and have select privileges on the availability database associated with the publisher database.

(top)

Change Data Capture

Databases enabled for change data capture (CDC) are able to leverage AlwaysOn Availability Groups in order to insure not only that the database remains available in the event of failure, but that changes to the database tables continue to be monitored and deposited in the CDC change tables. The order in which CDC and AlwaysOn Availability Groups are configured is not important. CDC enabled databases can be added to AlwaysOn Availability Groups, and databases that are members of an AlwaysOn availability group can be enabled for CDC. In both cases, however, CDC configuration is always performed on the current or intended primary replica. CDC uses the log reader agent and has the same limitations as described in the Log Reader Agent Modifications section earlier in this topic.

• Harvesting Changes for Change Data Capture Without Replication

  If CDC is enabled for a database, but replication is not, the capture process used to harvest changes from the log and deposit them in CDC change tables runs at the CDC host as its own SQL Agent job.

  In order to resume the harvesting of changes after failover, the stored procedure sp_cdc_add_job must be run at the new primary to create the local capture job.

  The following example creates the capture job.

  EXEC sys.sp_cdc_add_job @job_type = 'capture';
  

• Harvesting Changes for Change Data Capture With Replication

  If both CDC and replication are enabled for a database, the log reader handles the population of the CDC change tables. In this case, the techniques used by replication to leverage AlwaysOn Availability Groups will insure that changes continue to be harvested from the log and deposited in CDC change tables after failover. Nothing additional needs to be done for CDC in this configuration to insure that the change tables are populated.

• Change Data Capture Cleanup

  To insure that appropriate cleanup occurs at the new primary database, a local cleanup job should always be created. The following example creates the cleanup job.

  EXEC sys.sp_cdc_add_job @job_type = 'cleanup';
  

  Note

  You should create the jobs at all of the possible failover targets before failover, and mark them as disabled until the availability replica at a host becomes the new primary replica. The CDC jobs running at the old primary database should be also disabled when the local database becomes a secondary database. To disable and enable jobs, use the @enabled option of sp_update_job (Transact-SQL). For more information about creating CDC jobs, see sys.sp_cdc_add_job (Transact-SQL).

• Adding CDC Roles to an AlwaysOn Primary Database Replica

  When a table is enabled for CDC, it is possible to associate a database role with the capture instance. If a role is specified, the user wishing to use the CDC table-valued functions to access changes for the table must not only have select access to the tracked table columns, but must also be a member of the named role. If the specified role does not already exist, the role will be created. When database roles are automatically added to an AlwaysOn primary database, the roles are also propagated to the secondary databases of the availability group.

• Client Applications Accessing CDC Change Data and Always On

  Client applications that use the table-valued functions (TVFs) or linked servers to access change table data also need the ability to locate an appropriate CDC host after failover. The availability group listener name is the mechanism provided by AlwaysOn Availability Groups to transparently allow a connection to be retargeted to a different host. Once an availability group listener name is associated with an availability group, it is available to be used in TCP connection strings. Two different connection scenarios are supported through the availability group listener name.

  • One insures that connection requests are always directed to the current primary replica.

  • One insures that connection requests are directed to a read-only secondary replica.

  If used to locate a read-only secondary replica, a read-only routing list must also be defined for the availability group. For more information about routing access to readable secondaries, see Availability Group Listeners, Client Connectivity, and Application Failover (SQL Server).

  Note

  There is some propagation delay associated with the creation of an availability group listener name and its use by client applications to access an availability group database replica.

  Use the following query to determine whether an availability group listener name has been defined for the availability group hosting a CDC database. The query will return the availability group listener name if one has been created.

  SELECT dns_name 
  FROM sys.availability_group_listeners AS l
  INNER JOIN sys.availability_databases_cluster AS d
      ON l.group_id = d.group_id
  WHERE d.database_name = N'MyCDCDB';
  

• Redirecting the Query Load to a Readable Secondary Replica

  While in many cases a client application will always want to connect to the current primary replica that is not the only way to leverage AlwaysOn Availability Groups. If an availability group is configured to support readable secondary replicas, change data can also be gathered from secondary nodes.

  When an availability group is configured, the ALLOW_CONNECTIONS attribute associated with the SECONDARY_ROLE is used to specify the type of secondary access supported. If configured as ALL, all connections to the secondary will be allowed, but only those requiring read only access will succeed. If configured as READ_ONLY, it is necessary to specify read only intent when making the connection to the secondary database in order for the connection to succeed. For more information, see Configure Read-Only Access on an Availability Replica (SQL Server).

  The following query can be used to determine whether read-only intent is needed to connect to a readable secondary replica.

  SELECT g.name AS AG, replica_server_name, secondary_role_allow_connections_desc
  FROM sys.availability_replicas AS r
  JOIN sys.availability_groups AS g
      ON r.group_id = g.group_id
  WHERE g.name = N'MY_AG_NAME;
  

  Either the availability group listener name or the explicit node name can be used to locate the secondary replica. If the availability group listener name is used, access will be directed to any suitable secondary replica.

  When sp_addlinkedserver is used to create a linked server to access the secondary, the @datasrc parameter is used for the availability group listener name or the explicit server name, and the @provstr parameter is used to specify read-only intent.

  EXEC sp_addlinkedserver 
  @server = N'linked_svr', 
  @srvproduct=N'SqlServer',
  @provider=N'SQLNCLI11', 
  @datasrc=N'AG_Listener_Name', 
  @provstr=N'ApplicationIntent=ReadOnly', 
  @catalog=N'MY_DB_NAME';
  

• Client Access to CDC Change Data and Domain Logins

  In general, you should use domain logins for client access to change data residing in databases that are members of AlwaysOn availability groups. To insure continued access to change data after failover, the domain user will need access privileges on all of the hosts supporting availability group replicas. If a database user is added to a database in a primary replica, and the user is associated with a domain login, the database user is propagated to secondary databases and continues to be associated with the specified domain login. If the new database user is associated with a SQL Server authentication login, the user at the secondary databases will be propagated without a login. While the associated SQL Server authentication login could be used to access change data at the primary where the database user was originally defined, that node is the only one where access would be possible. The SQL Server authentication login would not be able to access data from any secondary database, nor from any new primary databases other than the original database where the database user was defined.

(top)

Change Tracking

A database enabled for change tracking (CT) can be part of an AlwaysOn availability group. No additional configuration is needed. Change tracking client applications that use the CDC table-valued functions (TVFs) to access change data will need the ability to locate the primary replica after failover. If the client application connects through the availability group listener name, connection requests will always be appropriately directed to the current primary replica.

Note

Change tracking data must always be obtained from the primary replica. An attempt to access change data from a secondary replica will result in the following error:

Msg 22117, Level 16, State 1, Line1

For databases that are members of a secondary replica (that is, for secondary databases), change tracking is not supported. Run change tracking queries on the databases in the primary replica.

(top)

Prerequisites, Restrictions, and Considerations for Using Replication

This section describes considerations for deploying replication with AlwaysOn Availability Groups, including prerequisites, restrictions, and recommendations.

Prerequisites

• When using transactional replication and the publishing database is in an availability group both the publisher and the distributor must run at least SQL Server 2012. The subscriber can be using a lower level of SQL Server.

• When using merge replication and the publishing database is in an availability group:

  • Push subscription: Both the publisher and the distributor must run at least SQL Server 2012.

  • Pull subscription: The publisher, distributor, and subscriber databases must be on at least SQL Server 2012. This is because the merge agent on the subscriber must understand how an availability group can fail over to its secondary.

• Placing the distribution database on an availability group is not supported.

• The Publisher instances satisfy all the prerequisites required to participate in an AlwaysOn availability group. For more information see Prerequisites, Restrictions, and Recommendations for AlwaysOn Availability Groups (SQL Server).

Restrictions

Supported combinations of replication on AlwaysOn Availability Groups:

	Publisher	Distributor3	Subscriber
Transactional	Yes1	No	Yes2
P2P	No	No	No
Merge	Yes	No	Yes2
Snapshot	Yes	No	Yes2

1 Does not include support for bi-directional and reciprocal transactional replication.

2 Failover to the replica database is a manual procedure. Automatic failover is not provided.

3 The Distributor database is not supported for use with AlwaysOn Availability Groups or database mirroring.

(top)

Considerations

• The distribution database is not supported for use with AlwaysOn Availability Groups or database mirroring. Replication configuration is coupled to the SQL Server instance where the Distributor is configured; therefore the distribution database cannot be mirrored or replicated. To provide high availability for the Distributor, use a SQL Server failover cluster. For more information, see AlwaysOn Failover Cluster Instances (SQL Server).

• Subscriber failover to a secondary database, while supported, is a relatively complex manual procedure. The procedure is essentially identical to the method used to fail over a mirrored subscriber database. Subscribers must be running SQL Server 2012 or later to participate in an availability group.

• Metadata and objects that exist outside the database are not propagated to the secondary replicas, including logins, jobs, linked servers. If you require the metadata and objects at the new primary database after failover, you must copy them manually. For more information, see Management of Logins and Jobs for the Databases of an Availability Group (SQL Server).

(top)

Related Tasks

Replication

• Configure Replication for AlwaysOn Availability Groups (SQL Server)

• Maintaining an AlwaysOn Publication Database (SQL Server)

• Administration (Replication)

Change data capture

• Enable and Disable Change Data Capture (SQL Server)

• Administer and Monitor Change Data Capture (SQL Server)

• Work with Change Data (SQL Server)

Change tracking

• Enable and Disable Change Tracking (SQL Server)

• Manage Change Tracking (SQL Server)

• Work with Change Tracking (SQL Server)

[Top]

See Also

Reference

sys.sp_cdc_add_job (Transact-SQL)

Concepts

Replication Subscribers and AlwaysOn Availability Groups (SQL Server)

Prerequisites, Restrictions, and Recommendations for AlwaysOn Availability Groups (SQL Server)

Overview of AlwaysOn Availability Groups (SQL Server)

AlwaysOn Availability Groups: Interoperability (SQL Server)

AlwaysOn Failover Cluster Instances (SQL Server)

About Change Data Capture (SQL Server)

About Change Tracking (SQL Server)

SQL Server Replication

Track Data Changes (SQL Server)