Share via

Manufacturing data solutions reference architectures

  • Article

Global manufacturing companies today face unprecedented complexity in managing their operations across a vast and fragmented data estate. They need to collect and analyze data from different hardware and software, in the cloud and at the edge, supported by many ISVs and vendors. In this environment, simply getting a holistic picture of operations is challenging; acting swiftly and effectively on that information is impossible.

Manufacturers know that modernization of their data estate, combined with the massive potential of AI to produce insights and solve problems, is a critical step to secure the future of their business. However, they require assistance in consolidating and interpreting the data produced by their operations. They also need to effectively, safely, and accurately utilize AI to address their specific needs promptly.

Manufacturing data solutions in Microsoft Fabric can gather data from various sources such as MES, machines, sensors, PLCs, and applications. This data is then structured into a manufacturing-specific data model and graphs, which facilitate data-driven applications like AI assistants for operational visibility.

Current challenges

Manufacturers want to digitally transform their factories, but they often encounter challenges due to the dispersion of data across numerous disparate systems. They also lack the specialized technical personnel, like data scientists or AI experts, who can handle the intricacies and large amounts of data integration required to establish a manufacturing data foundation.

In some cases, manufacturers can prove the value of AI in a proof-of-concept but don’t have the technology infrastructure, data foundation, and resources they need to scale AI solutions across the entire factory network.

Benefits of manufacturing data solutions in Microsoft Fabric

Manufacturing data solutions in Microsoft Fabric can help you:

  • Accelerate time to value with prebuilt data ingestion plugins to leading MES providers, factory applications, and IoT management platforms.

  • Build a semantic graph across various manufacturing processes.

  • Use generative AI to bring the power of natural language interfaces  to address specific manufacturing use cases such as quality issue resolution, root cause analysis and more.

  • Accelerate the deployment of generative AI solutions across operations with repeatability using your unified manufacturing data foundation on the Microsoft Cloud for Manufacturing.

Manufacturing data solutions in Microsoft Fabric - Reference Architecture

Microsoft Cloud for Manufacturing provides a reference architecture for manufacturing data solutions. It provides an overview of common and recommended implementation technology choices, terminology, technology principles, common configuration environments, and composition of applicable services.

Screenshot shows reference architecture for manufacturing data solutions.

Download a printable PDF of this reference architecture diagram.

The key stages/dataflow are as follows:

On-premises data sources

The manufacturing data solutions in Microsoft Fabric architecture start with ingestion of industry data sources on the factory floor. The architecture includes systems that generate Operational Technology (OT) data, such as Programmable Logic Controllers (PLCs), Distributed Control Systems (DCS), or full Manufacturing Execution Systems (MES). It can also include related IT data sources, such as Enterprise Resource Planning (ERP) systems and associated databases.

Data ingestion, normalization, and contextualization

OT and IT data need to be ingested, normalized, and contextualized before it can be used in the cloud. For use in manufacturing data solutions, the data is sent to the cloud in OPC UA (IEC 62541) open-standard format. OPC UA is the leading industrial interoperability standard for industrial data modelling and secure communication from sensor to cloud. The source device or system supplies this data along with the corresponding metadata. This data is then transmitted to Microsoft Fabric where it is stored in the Parquet format.

At preview, manufacturing data solutions supports the use of multiple systems for connecting, normalizing, and contextualizing data offered by both Microsoft and ISV partners.

Azure IoT Operations, currently in public preview, is Microsoft’s comprehensive solution to capture asset data, process it at the edge, and send it to the cloud with Azure Arc–enabled services. IoT Operations is used for connectivity with the industrial edge at low latency and high fidelity, built to support powerful cloud analytics, apps, and digital twins. For more information, see Azure IoT Operations and how to deploy its capabilities and services.

Azure Data Gateway is an on-premises component required for accessing on-premises databases behind corporate firewalls in a secure way. It can be deployed in Edge gateway systems and configured to send on-premises data to Azure Data Factory, Azure Logic Apps or directly to Microsoft Fabric. It comes with over 50 connectors to various on-premises systems.

Microsoft ISV Partner Litmus, which offers a prebuilt portfolio of 275+ industrial data connectors, teamed with Microsoft to enable seamless delivery of standardized OPC UA data from the edge into Fabric for use in manufacturing data solutions as well. Litmus also offers a tool, Litmus Edge Manager, to provision, configure and manage connectors, available on the Azure Marketplace.

Microsoft has developed a connector to streamline edge data from GE Proficy industrial systems, such as PLCs, SCADA, and other Human-Machine Interfaces (HMIs) to the manufacturing data solutions.

After data is ingested at the edge, they can be brought to the cloud via several paths:

Data transformation in Fabric and Manufacturing data solutions

After data lands into Fabric, the data is transformed into a refined or Silver layer to be ready for use in the manufacturing data solutions knowledge graph. ISA-95 data protocol, an international standard that facilitates the integration of enterprise and control systems in manufacturing. It includes a layered model to represent the hierarchy and relationships within a manufacturing organization. It enables the manufacturing data solutions knowledge graph to represent factory data in a highly accurate, nuanced, and timely manner. This data in turn provides the foundation for the Copilot template to deliver valuable insight into factory operations.

Copilot template for factory operations on Azure AI

The copilot template for factory operations on Azure AI, accelerates partners’ successful adoption of the Microsoft Copilot stack by offering out-of-box templates, connectors, and skills, packaged in an OpenAI standard plugin.

The copilot template provides:

  • Domain-specific prompt templates, data grounding skills, and connectors.

  • Thorough validation of copilot outputs, via post-processing, to avoid incorrect information.

  • RAI guardrails to ensure only relevant, safe, responsible responses are given within the manufacturing setting.

Partners can also create and register their own prompt templates, skills, and connectors as desired, to extend the capabilities of the manufacturing OpenAI plugin.

Applications

Manufacturing data solutions and copilot template for factory operations on Azure AI are designed from the ground up with extensibility in mind. Partners and customers can use these capabilities to enhance existing data and collaborative applications from both Microsoft and ISVs.

Data applications: The manufacturing data solutions knowledge graph can power various robust data tools. These include Fabric Notebooks, Power BI views, and Power Apps from Microsoft, as well as partner data platforms and applications.

Collaborative applications: The copilot template for factory operations on Azure AI is a foundation for building powerful generative AI applications. These applications span various use cases, from collaboration in Microsoft Teams and Microsoft 365 copilots, and also copilot experiences from manufacturing partners such as Sight Machine and Rockwell Automation.

Important

Currently, an approved preview GSI or ISV is required for delivery. Microsoft Cloud Solution Center will continue to provide up to date access to the approved partner offers and provide access to these offers via Microsoft AppSource and Azure Marketplace.

Next steps

Get started with manufacturing data solutions (preview) in Microsoft Fabric.