Edit

Share via

Quality assurance

Azure Event Hubs
Azure Machine Learning
Azure Stream Analytics
Power BI

Quality assurance systems allow businesses to prevent defects throughout their processes of delivering goods or services to customers. Building such a system that collects data and identifies potential problems along a pipeline can provide enormous advantages. For example, in digital manufacturing, quality assurance across the assembly line is imperative. Identifying slowdowns and potential failures before they occur rather than after they are detected can help companies reduce costs for scrap and rework while improving productivity.

Architecture

Architecture diagram shows data into Azure Event Hubs, then to Data Lake, then processes with Stream Analytics, finally to Power BI visualization.

Download a Visio file of this architecture.

Dataflow

  1. Source system event generator streams data into Azure Event Hubs.
  2. Event Hubs uses Capture to send raw events to Data Lake.
  3. A Stream Analytics job reads real-time data from Event Hubs.
  4. A Stream Analytics job calls ML model in Azure Machine Learning to predict failure/defect.
  5. A Stream Analytics job sends stream aggregations to Power BI real-time dashboard for operations.
  6. A Stream Analytics job pushes the processed real-time data into Azure Synapse SQL Pool.
  7. A Logic Apps sends alerts from streaming data to a mobile phone.
  8. Power BI is used for results visualization.

Components

  • Event Hubs ingests assembly line events and passes them on to Stream Analytics and an Azure ML Web Service.
  • Azure Stream Analytics: Stream Analytics accepts the input stream from Event Hubs, calls an Azure ML Web Service to do predictions, and sends the stream to Azure Synapse and Power BI and Logic Apps for alerts.
  • Azure Machine Learning: Machine Learning helps you design, test, operationalize, and manage predictive analytics solutions in the cloud and deploy web services that can be called by Stream Analytics.
  • Storage Accounts: Azure Storage stores raw events stream data from Event Hubs and serves for long-term data persistence.
  • Logic Apps: Sends alerts generated from the streaming data into operator device.
  • Synapse Analytics: Store relational data for ad-hoc and planned analytical processing and user analytical queries.
  • Power BI: visualizes real-time operational dashboards and also servers for analytical reports.

Alternatives

  • Depending on the scenario, the basic architecture can be simplified by removing the batch layer - removing Storage for raw events and Azure Synapse for relational data
  • Azure SQL Database is a managed relational database-as-a service. Depending on your data volumes and access patterns, you may choose Azure SQL Database.
  • Azure Functions provides an effective serverless approach if the workload architecture is centered around fine grained distributed components, requiring minimal dependencies, where individual components are only required to run on demand (not continuously) and orchestration of components is not required.
  • IoT Hub acts as a central message hub for secure bi-directional communication with per-device identity between the cloud platform and the construction equipment and other site elements. IoT Hub can rapidly collect data for each device for ingestion into the data analytics pipeline.

Scenario details

Potential use cases

This solution shows how to predict failures using the example of manufacturing pipelines (assembly lines). This is done by utilizing test systems already in place and failure data, specifically looking at returns and functional failures at the end of assembly line. By combining these with domain knowledge and root cause analysis within a modular design that encapsulates main processing steps, we provide a generic advanced analytics solution that uses machine learning to predict failures before they happen. Early prediction of future failures allows for less expensive repairs or even discarding, which are usually more cost efficient than going through recall and warranty cost.

Considerations

These considerations implement the pillars of the Azure Well-Architected Framework, which is a set of guiding tenets that can be used to improve the quality of a workload. For more information, see Microsoft Azure Well-Architected Framework.

Scalability

The majority of the components used in this example scenario are managed services that scale based on your current scenario needs.

For general guidance on designing scalable solutions, see the performance efficiency checklist in the Azure Architecture Center.

Security

Security provides assurances against deliberate attacks and the abuse of your valuable data and systems. For more information, see Overview of the security pillar.

Managed identities for Azure resources are used to provide access to other resources internal to your account. Only allow access to the requisite resources in those identities to ensure that nothing extra is exposed to your functions (and potentially to your customers).

For general guidance on designing secure solutions, see the Azure Security Documentation.

Resiliency

All of the components in this scenario are managed, so at a regional level they are all resilient automatically.

For general guidance on designing resilient solutions, see Reliability design principles.

Next steps