Pause and resume data streams (preview)
Note
Enhanced capabilities are enabled by default when you create eventstreams now. If you have eventstreams that were created using standard capabilities, those eventstreams will continue to work. You can still edit and use them as usual. We recommend that you create a new eventstream to replace standard eventstreams so that you can take advantage of additional capabilities and benefits of enhanced eventstreams.
The Pause and Resume (that is, Deactivate and Activate) features in Eventstream give you a full control over your data streams, enabling you to pause data streaming from various sources and destinations within Eventstream. You can then resume data streaming seamlessly from the paused time or a customized time, ensuring no data loss.
- Activate/Deactivate All: Quickly pause and resume all data traffic flowing in and out of Eventstream using the Activate All and Deactivate All options on the menu bar.
- Activate/Deactivate Toggle Switch Button: Each node has a toggle switch button, allowing you to activate (that is, resume) or deactivate (that is, pause) the data streaming from or to selected sources and destinations.
The following table outlines the description of different node statuses:
| Node Status | Description |
|---|---|
| Active | Data source is currently active and data is flowing in or out of Eventstream. |
| Inactive | Data source is currently inactive, and no data is flowing in or out of Eventstream. |
| Loading | Data source is in the process of being turned on or off. |
| Error | Data source is currently paused due to errors. |
| Warning | Data source is operational but experiencing some issues, although data traffic is still occurring. |
Activating or deactivating a node using the switch toggle
For nodes that support pause and resume features, you can easily manage their data flow using the toggle switch. Find the desired node and toggle the switch on or off to activate (that is, resume) or deactivate (that is, pause) the data traffic. Nodes that don't currently support pause and resume functionality won't have a toggle switch.
The table below describes the available resume options:
| Resume Option | Description |
|---|---|
| When streaming was last stopped | Resumes from the point where streaming was last stopped |
| Now | Resumes from the current time |
| Custom time | Resumes from a customized time |
Here's a detailed table of the nodes that support pause and resume functionality along with the available resume options:
| Node | Type | Supports Pause and Resume | Resume Options |
|---|---|---|---|
| Azure Event Hubs | Source | YES | - When streaming was last stopped - Now - Custom time |
| Azure Service Bus | Source | YES | - When streaming was last stopped |
| Azure IoT Hub | Source | YES | - When streaming was last stopped - Now - Custom time |
| Sample Data | Source | YES | - Now |
| Azure SQL Database CDC | Source | YES | - When streaming was last stopped |
| PostgreSQL Database CDC | Source | YES | - When streaming was last stopped |
| MySQL Database CDC | Source | YES | - When streaming was last stopped |
| Azure Cosmos DB CDC | Source | YES | - When streaming was last stopped |
| SQL Server on VM DB CDC | Source | YES | - When streaming was last stopped |
| Azure SQL Managed Instance CDC | Source | YES | - When streaming was last stopped |
| Google Cloud Pub/Sub | Source | YES | - When streaming was last stopped |
| Amazon Kinesis Data Streams | Source | YES | - When streaming was last stopped |
| Confluent Kafka | Source | YES | - When streaming was last stopped |
| Apache Kafka | Source | YES | - When streaming was last stopped |
| Amazon MSK Kafka | Source | YES | - When streaming was last stopped |
| Custom App | Source | NO | |
| Fabric Workspace events source | Source | NO | |
| Fabric OneLake events | Source | NO | |
| Fabric Job events | Source | NO | |
| Azure Blob storage | Source | NO | |
| Lakehouse | Destination | YES | - When streaming was last stopped - Now - Custom time |
| Eventhouse (Event processing before ingestion) | Destination | YES | - When streaming was last stopped - Now - Custom time |
| Custom App | Destination | NO | |
| Eventhouse (Direct Ingestion) | Destination | NO | |
| Fabric Activator | Destination | YES | - When streaming was last stopped - Now - Custom time |
| Derived stream | Destination | NO |
| Node | Type | Supports Pause and Resume | Resume Options |
|---|---|---|---|
| Sample Data | Source | YES | - Now |
| Azure Event Hubs | Source | YES | - When streaming was last stopped - Now - Custom time |
| Azure IoT Hub | Source | YES | - When streaming was last stopped - Now - Custom time |
| Custom App | Source | NO | |
| Custom App | Destination | NO | |
| Lakehouse | Destination | YES | - When streaming was last stopped - Now - Custom time |
| KQL Database (Direct Ingestion) | Destination | NO | |
| KQL Database (Event processing before ingestion) | Destination | YES | - When streaming was last stopped - Now - Custom time |
| Fabric Activator | Destination | YES | - When streaming was last stopped - Now - Custom time |
Activating or deactivating all nodes
You can easily pause or resume all data traffic within Eventstream by selecting either the Activate All or Deactivate All option from the menu bar. When selecting Activate All, the available resume options may differ based on the sources and destinations configured in your eventstream. Refer to the detailed table in the previous section for specific resume options for each node. This action will either resume or pause all data traffic flowing in or out of Eventstream. It only applies to nodes that support pause and resume functionality. For nodes that don't currently support this feature, data traffic can't be paused.
