Difference between revisions of "PMQ Architecture"

From ESS-WIKI
Jump to: navigation, search
 
(130 intermediate revisions by 3 users not shown)
Line 1: Line 1:
 
= Introduction =
 
= Introduction =
  
 This page introduces Advantech Predictive Maintenance and Quality ( PMQ ) for failure prediction solution.
+
This page introduces Advantech Predictive Maintenance and Quality ( PMQ ) solution.
  
    Advantech PMQ includes the deployment of the trained model to make predictions and UI visualization and recommendations for corresponding strategies. The objective is to provide software developers basic concepts and better understating of PMQ deployment and to be more effective to bring your predictive model to production with Advantech PMQ architecture.
+
'''Predictive Maintenance and Quality'''
  
== An overview of Predictive Maintenance and Quality ==
+
    PMQ solution aquire multiple data sources in real time to predict asset failure or quality issues so your organization can avoid costly downtime and reduce maintenance costs. Driven by predictive analytics, these solutions detect even minor anomalies and failure patterns to determine the assets and operational processes that are at the greatest risk of problems or failure. This early identification of potential concerns helps you deploy limited resources more cost effectively, maximize equipment uptime and enhance quality and supply chain processes, ultimately improving customer satisfaction.
  
== Why Edge Intelligence ==
+
    Advantech PMQ solution includes the '''deployment '''of the trained model to '''make predictions''' and '''visualization '''UI and '''recommendations '''for corresponding strategies. The objective is to provide software developers basic concepts and better understating of PMQ deployment and to be '''more effective''' to bring your predictive model to production with Advantech PMQ architecture.
  
    Edge computing is a distributed information technology (IT) architecture in which client data is processed at the periphery of the network, as close to the originating source as possible. Time-sensitive data in edge computing may be processed at the point of origin by an intelligent device or sent to an intermediary server located in close geographical proximity to the client. Data that is less time sensitive is sent to the cloud for historical analysis, big data analytics, and long-term storage.
+
 
 +
 
 +
== Edge Intelligence ==
 +
 
 +
[[File:AdvantechIoTSolutionArchitecture 20170822.jpg|RTENOTITLE]]
 +
 
 +
   Advantech EIS adopts edge computing architecture for its IoT solution. '''Edge computing''' is a distributed information technology (IT) architecture in which client data is processed at the periphery of the network, as close to the originating source as possible.
 +
 
 +
'''Time-sensitive''' data in edge computing may be processed at the point of origin by an intelligent device or sent to an intermediary server located in close geographical proximity to the client.
 +
 
 +
Data that is less time sensitive is sent to the '''cloud '''for '''historical analysis''', '''big data '''analytics, and long-term storage.
  
 
= Advantech PMQ =
 
= Advantech PMQ =
  
== Advantech PMQ means for Customer ==
+
== Advantech PMQ Solution means for Customer: ==
  
== PMQ Architecture & Data Flow ==
+
[[File:PMQ FeatureV1.0.jpg|RTENOTITLE]]
[[File:PMQ Lifecycle.jpg|RTENOTITLE]]
 
  
== Edge Intelligence PMQ Framework ==
+
<span style="font-size:large;">'''* IPC / IoT / Vertical Sensor Data Acquire & Storage'''</span>
  
[[File:Edge_PMQ_Service_Framework.jpg|800x600px|PMQ Service Framework]]
+
&nbsp; &nbsp; &nbsp;Advantech’s focus is on edge device development, to ensure that the EIS software suite includes the southbound sensing device connectivity that handles diverse sensing protocols such as Modbus, OPC, BACnet, Wireless IP/NonIP, and so on. Those protocols are plugin modules that take care of sensor data, data normalization, and communication The EIS mainly handles the northbound cloud connectivity and intelligence facilities; these are based on the micro service container to modularize the different cloud connections and device management.
  
== PMQ Data Format / Event / Action ==
+
<span style="font-size:large;">'''* Big Data Storage and Analytics'''</span>
  
== PMQ Visualization and Maintenance&nbsp;of&nbsp;WISE-Cloud/RMM 3.3 ==
+
'''<font size="4">&nbsp;</font>'''<span style="font-size:small;">Edge Intelligence Server collects data and sends to WISE-PaaS then storages&nbsp;in NoSQL DB. WISE-PaaS&nbsp;provides rich REST APIs to aquire data for data pre-process and analysis.&nbsp;</span>
 +
 
 +
<span style="font-size:large;">'''* Visualization & Maintenance'''</span>
 +
 
 +
<span style="font-size:large;">'''&nbsp; &nbsp;* Deploy / Upgrade by OTA'''</span>
 +
 
 +
<span style="font-size:large;">'''* Event / Action&nbsp;'''</span>
 +
 
 +
<span style="font-size:large;">'''* Acceleration – for PoC, PoV and Production'''</span>
 +
 
 +
== PMQ Lifecycle and Architecture ==
 +
 
 +
&nbsp; &nbsp;&nbsp;
 +
 
 +
[[File:Adv PMQ Lifecycle.jpg|RTENOTITLE]]
 +
 
 +
[[File:PMQ Lifecycle.jpg|900x650px|Overview of Advantech PMQ]]
 +
 
 +
== EIS&nbsp;PMQ Framework ==
 +
 
 +
&nbsp; &nbsp; Advantech EIS adopts edge computing architecture for its IoT solution as below picture. EIS enables local IoT networks to perform edge intelligence to maximize energy efficiency, reduce privacy threats, promote easy implementation and modularization, and minimize latencies.
 +
 
 +
&nbsp; &nbsp; The EIS intelligence facilities also adopt the micro service container to deal with the data ingestion workload such as data pre-processing and cleaning. The most valuable faculty in the EIS software suite is streaming analytics. Advantech provides the IPC device PMQ (Predictive Maintenance and Quality) to prove the concept of prediction in the edge field for real-time analytics and upgrade the analytic module that is also based on the micro service container technology from the cloud service for updating more accuracy analytic purpose. The customer can leverage such a framework to develop their own analytic module or PMQ module with EIS open standard architecture. The entire open standard follows the MQTT protocol and the Docker container technology as its foundation framework.
 +
 
 +
[[File:Edge PMQ Service Framework.jpg|700x500px|PMQ Service Framework]]
  
 
= Advantech PMQ Model =
 
= Advantech PMQ Model =
 +
 +
Advantech provides IPC key components (e.g. HDD Disk, ... ) failure predictive&nbsp;model.&nbsp; Here is the&nbsp;step&nbsp;of&nbsp;training&nbsp;HDD Disk Failure predictive model&nbsp;for your reference.
  
 
== HDD Failure Prediction Model ==
 
== HDD Failure Prediction Model ==
  
= How To  =
+
1. Get the&nbsp;HDD raw data
 +
 
 +
2. Get useful HDD information
 +
 
 +
[[File:2017-08-11 165538.png|RTENOTITLE]]
 +
 
 +
 
 +
 
 +
3. Flow of training&nbsp;mathematics module
 +
 
 +
[[File:2017-08-11 135901.png|RTENOTITLE]]
 +
 
 +
 
 +
 
 +
 
 +
 
 +
Using&nbsp;Logistic Regression Algorithm to classify the false samples in red and the true samples in blue.
 +
 
 +
[[File:Logistic Regression Algorithm.png|RTENOTITLE]]
 +
 
 +
 
 +
 
 +
4. Benchmark for PMQ accuracy&nbsp;
 +
 
 +
[[File:2017-08-11 165747.png|RTENOTITLE]]
 +
 
 +
5. Alert and&nbsp;Suggestion of HDD PMQ&nbsp;
 +
 
 +
{| border="1" cellspacing="1" cellpadding="1"
 +
|-
 +
|
 +
#of Event
 +
 
 +
| Event Message
 +
| Suggestion ( Action ) Message
 +
| Condition
 +
|-
 +
| 1
 +
| Over temperature
 +
|
 +
Lower system temperature (<40°C)
 +
 
 +
| smart5 >= 10 &#124;&#124; smart197 >= 2
 +
|-
 +
| 2
 +
| Disk aging.
 +
| Backup data to new disk.
 +
| smart9 >= 26280
 +
|-
 +
| 3
 +
| Disk read/writes error frequently.
 +
|
 +
Backup data to new disk.
 +
 
 +
| smart187 >= 1
 +
|-
 +
| 4
 +
| Power failure
 +
| Check power source
 +
| smart192 >= 190
 +
|}
 +
 
 +
= How To =
 +
 
 +
&lt;parsererror style="display: block; white-space: pre; border: 2px solid #c77; padding: 0 1em 0 1em; margin: 1em; background-color: #fdd; color: black"&gt;
 +
 
 +
=== This page contains the following errors: ===
 +
<div style="font-family:monospace;font-size:12px">error on line 1 at column 720: attributes construct error</div>
 +
=== Below is a rendering of the page up to the first error. ===
 +
 
 +
&lt;/parsererror&gt;
 +
 
 +
== Visualization and Maintenance with WISE-PaaS/RMM ==
 +
 
 +
If Advantech PMQ service running on edge device. There will have a&nbsp; PMQ icon ( RED&nbsp;frame ) as below picture on WISE-PaaS/RMM device manager. To&nbsp;click this icon then pop up PMQ Dialog as "Predictive Goo/Failure".
 +
 
 +
[[File:PMQ UI 0.jpg|1400x900px|WISE-PaaSToPMQ]]
 +
 
 +
 
 +
 
 +
'''<span style="font-size:large;">Health: Good: (100% ~ 46&nbsp;%), Warning: ( 45% ~ 34%), Bad: ( 33% ~ 0% )</span>'''
 +
 
 +
[[File:PMQ UI 1.jpg|1400x900px|Predictive Good]]
 +
 
 +
[[File:PMQ UI 2.jpg|1400x900px|Predictive Failure]]
 +
 
 +
== Make a PMQ Service ==
 +
 
 +
&nbsp; &nbsp; Customer can&nbsp;implement its own&nbsp;PMQ service as developing a&nbsp;plug-in handler. &nbsp;The PMQ plug-in handler includes&nbsp;collecting&nbsp;raw data and built-in have been&nbsp;trained&nbsp;model to predictive failure rate.&nbsp;
 +
 
 +
We also provide the&nbsp;PMQ plug-in Sample help&nbsp;customer develop its PMQ service with Advantech PMQ System.
 +
 
 +
You can refer the&nbsp;[[WISE-Agent_Sample_Handler|WISE-Agent Sample Handler]]&nbsp;for detail about "How to develop a plug-in."&nbsp;
 +
 
 +
You can download PMQ plug-in sample at Github Sample/PMQ-SamplePlugin
 +
<pre>git clone --branch v3.3 https://github.com/ADVANTECH-Corp/WISEAgent.git</pre>
 +
 
 +
== Package PMQ Installation Package ==
 +
 
 +
=== PMQ Service Installer ===
 +
 
 +
Customer need modify the "agent_config.xml" follow below rule
 +
<pre><DeviceName> &nbsp;: Plugin-Name ( ex: HDD_PMQ )
 +
<DevID>      &nbsp;: <DeviceName> => ( ex: HDD_PMQ )
 +
DevType      &nbsp;: Service ( Fixed ) </pre>
 +
 
 +
=== OTA Installation Package ===
 +
 
 +
&nbsp;'''<span style="font-size:large;">[[WISE-PaaS/OTA_Packager_Tool|WISE-PaaS/OTA Packager Tool]]:</span>'''
 +
 
 +
<span style="font-size:large;">&nbsp; &nbsp; Customer needs use this OTA Packager Tool&nbsp; to package your PMQ Service OTA Installation Package.</span>&nbsp;
 +
 
 +
<span style="font-size:large;">'''Nameing Rule:''' &nbsp; Please follow the name rule for PMQ OTA Installation Package.</span>
 +
 
 +
<span style="font-size:larger;">&nbsp; &nbsp;Agent_'''<<span style="color:#FF0000;">ServiceName</span>>'''_'''<<span style="color:#FF0000;">Version</span>>'''.zip</span> &nbsp;( Example: Agent_HDD_PMQ_1.0.1.zip )
 +
 
 +
== Install / Upgrade ==
 +
 
 +
<span style="font-size:larger;">'''Install HDD_PMQ Agent in Windows System'''</span>
 +
 
 +
Execute "Agent_HDD_PMQ.exe" to install the HDD_PMQ Agent, and follow the steps to finish the installation.
 +
 
 +
[[File:HDD PMQ Install 1.png|RTENOTITLE]]
 +
 
 +
[[File:HDD PMQ INSTALL 2.png|RTENOTITLE]]
 +
 
 +
[[File:HDD PMQ INSTALL 3.png|RTENOTITLE]]
 +
 
 +
[[File:HDD PMQ INSTALL 4.png|RTENOTITLE]]
 +
 
 +
[[File:HDD PMQ INSTALL 5.png|RTENOTITLE]]
 +
 
 +
<span style="font-size:larger;">'''Install HDD_PMQ Agent in RMM 3.3 Agent Plus version in Windows System'''</span>
 +
 
 +
'''[[File:AgentPlus 1.png|RTENOTITLE]]'''
 +
 
 +
The&nbsp;'''RMM 3.3 Agent Plus&nbsp;'''installer provide three different type installations: Typical, Custom and Complete.
 +
 
 +
[[File:AgentPlus 2.png|RTENOTITLE]]
 +
 
 +
The '''RMM 3.3 Agent Plus'''&nbsp;include three program features:
 +
 
 +
1. MQTT Broker for internal MQTT bus.
 +
 
 +
2. RMM 3.3 Agent to communicate between WISE-PaaS/RMM Server and MQTT bus.
 +
 
 +
3. HDD_PMQ Agent for HDD smart retrieve and PMQ caculate then report to MQTT bus.
 +
 
 +
[[File:AgentPlus 3.png|RTENOTITLE]]
 +
 
 +
[[File:AgentPlus 4.png|RTENOTITLE]]
 +
 
 +
In rest to steps, the installer will trigger the MQTT Broker, RMM 3.3 Agent and HDD_PMQ Agent installer sequentially.
 +
 
 +
[[File:AgentPlus MQTT .png|RTENOTITLE]]
 +
 
 +
[[File:AgentPlus RMMAgent.png|RTENOTITLE]]
 +
 
 +
The detail of RMM 3.3 Agent Installation is skipped to focused on RMM 3.3 Agent Plus Installation.
 +
 
 +
[[File:AgentPlus HDDPMQ.png|RTENOTITLE]]
 +
 
 +
[[File:AgentPlus final.png|RTENOTITLE]]
 +
 
 +
<span style="font-size:larger;">'''Update HDD_PMQ Agent'''</span>
 +
 
 +
Upload Agent_HDD_PMQ-V1.0.xxx...zip OTA upgrade package to OTA Server.
 +
 
 +
[[File:Upload PMQ.png|1280px|Upload PMQ.png]]
 +
 
 +
[[File:Upload PMQ 1.png|1280px|Upload PMQ 1.png]]
 +
 
 +
Select HDD_PQM Update Package to upgrade target devices.
 +
 
 +
[[File:Upload PMQ 2.png|800px|RTENOTITLE]]
 +
 
 +
[[File:Upload PMQ 3.png|800px|RTENOTITLE]]
 +
 
 +
[[File:Upload PMQ 4.png|800px|RTENOTITLE]]
  
== Implement a New PMQ Service in PMQ System ==
+
[[File:Upload PMQ 5.png|800px|RTENOTITLE]]
  
[[WISE-Agent_Sample_Handler|WISE-Agent Sample Handler]]
+
[[File:Upload PMQ 6.png|800px|RTENOTITLE]]

Latest revision as of 02:09, 23 August 2018

Introduction

This page introduces Advantech Predictive Maintenance and Quality ( PMQ ) solution.

Predictive Maintenance and Quality

    PMQ solution aquire multiple data sources in real time to predict asset failure or quality issues so your organization can avoid costly downtime and reduce maintenance costs. Driven by predictive analytics, these solutions detect even minor anomalies and failure patterns to determine the assets and operational processes that are at the greatest risk of problems or failure. This early identification of potential concerns helps you deploy limited resources more cost effectively, maximize equipment uptime and enhance quality and supply chain processes, ultimately improving customer satisfaction.

    Advantech PMQ solution includes the deployment of the trained model to make predictions and visualization UI and recommendations for corresponding strategies. The objective is to provide software developers basic concepts and better understating of PMQ deployment and to be more effective to bring your predictive model to production with Advantech PMQ architecture.


Edge Intelligence

RTENOTITLE

   Advantech EIS adopts edge computing architecture for its IoT solution. Edge computing is a distributed information technology (IT) architecture in which client data is processed at the periphery of the network, as close to the originating source as possible.

Time-sensitive data in edge computing may be processed at the point of origin by an intelligent device or sent to an intermediary server located in close geographical proximity to the client.

Data that is less time sensitive is sent to the cloud for historical analysis, big data analytics, and long-term storage.

Advantech PMQ

Advantech PMQ Solution means for Customer:

RTENOTITLE

* IPC / IoT / Vertical Sensor Data Acquire & Storage

     Advantech’s focus is on edge device development, to ensure that the EIS software suite includes the southbound sensing device connectivity that handles diverse sensing protocols such as Modbus, OPC, BACnet, Wireless IP/NonIP, and so on. Those protocols are plugin modules that take care of sensor data, data normalization, and communication The EIS mainly handles the northbound cloud connectivity and intelligence facilities; these are based on the micro service container to modularize the different cloud connections and device management.

* Big Data Storage and Analytics

 Edge Intelligence Server collects data and sends to WISE-PaaS then storages in NoSQL DB. WISE-PaaS provides rich REST APIs to aquire data for data pre-process and analysis. 

* Visualization & Maintenance

   * Deploy / Upgrade by OTA

* Event / Action 

* Acceleration – for PoC, PoV and Production

PMQ Lifecycle and Architecture

    

RTENOTITLE

Overview of Advantech PMQ

EIS PMQ Framework

    Advantech EIS adopts edge computing architecture for its IoT solution as below picture. EIS enables local IoT networks to perform edge intelligence to maximize energy efficiency, reduce privacy threats, promote easy implementation and modularization, and minimize latencies.

    The EIS intelligence facilities also adopt the micro service container to deal with the data ingestion workload such as data pre-processing and cleaning. The most valuable faculty in the EIS software suite is streaming analytics. Advantech provides the IPC device PMQ (Predictive Maintenance and Quality) to prove the concept of prediction in the edge field for real-time analytics and upgrade the analytic module that is also based on the micro service container technology from the cloud service for updating more accuracy analytic purpose. The customer can leverage such a framework to develop their own analytic module or PMQ module with EIS open standard architecture. The entire open standard follows the MQTT protocol and the Docker container technology as its foundation framework.

PMQ Service Framework

Advantech PMQ Model

Advantech provides IPC key components (e.g. HDD Disk, ... ) failure predictive model.  Here is the step of training HDD Disk Failure predictive model for your reference.

HDD Failure Prediction Model

1. Get the HDD raw data

2. Get useful HDD information

RTENOTITLE


3. Flow of training mathematics module

RTENOTITLE



Using Logistic Regression Algorithm to classify the false samples in red and the true samples in blue.

RTENOTITLE


4. Benchmark for PMQ accuracy 

RTENOTITLE

5. Alert and Suggestion of HDD PMQ 

  1. of Event
Event Message Suggestion ( Action ) Message Condition
1 Over temperature

Lower system temperature (<40°C)

smart5 >= 10 || smart197 >= 2
2 Disk aging. Backup data to new disk. smart9 >= 26280
3 Disk read/writes error frequently.

Backup data to new disk.

smart187 >= 1
4 Power failure Check power source smart192 >= 190

How To

<parsererror style="display: block; white-space: pre; border: 2px solid #c77; padding: 0 1em 0 1em; margin: 1em; background-color: #fdd; color: black">

This page contains the following errors:

error on line 1 at column 720: attributes construct error

Below is a rendering of the page up to the first error.

</parsererror>

Visualization and Maintenance with WISE-PaaS/RMM

If Advantech PMQ service running on edge device. There will have a  PMQ icon ( RED frame ) as below picture on WISE-PaaS/RMM device manager. To click this icon then pop up PMQ Dialog as "Predictive Goo/Failure".

WISE-PaaSToPMQ


Health: Good: (100% ~ 46 %), Warning: ( 45% ~ 34%), Bad: ( 33% ~ 0% )

Predictive Good

Predictive Failure

Make a PMQ Service

    Customer can implement its own PMQ service as developing a plug-in handler.  The PMQ plug-in handler includes collecting raw data and built-in have been trained model to predictive failure rate. 

We also provide the PMQ plug-in Sample help customer develop its PMQ service with Advantech PMQ System.

You can refer the WISE-Agent Sample Handler for detail about "How to develop a plug-in." 

You can download PMQ plug-in sample at Github Sample/PMQ-SamplePlugin

git clone --branch v3.3 https://github.com/ADVANTECH-Corp/WISEAgent.git

Package PMQ Installation Package

PMQ Service Installer

Customer need modify the "agent_config.xml" follow below rule

<DeviceName>  : Plugin-Name ( ex: HDD_PMQ )
<DevID>       : <DeviceName>  => ( ex: HDD_PMQ )
DevType       : Service ( Fixed ) 

OTA Installation Package

 WISE-PaaS/OTA Packager Tool:

    Customer needs use this OTA Packager Tool  to package your PMQ Service OTA Installation Package. 

Nameing Rule:   Please follow the name rule for PMQ OTA Installation Package.

   Agent_<ServiceName>_<Version>.zip  ( Example: Agent_HDD_PMQ_1.0.1.zip )

Install / Upgrade

Install HDD_PMQ Agent in Windows System

Execute "Agent_HDD_PMQ.exe" to install the HDD_PMQ Agent, and follow the steps to finish the installation.

RTENOTITLE

RTENOTITLE

RTENOTITLE

RTENOTITLE

RTENOTITLE

Install HDD_PMQ Agent in RMM 3.3 Agent Plus version in Windows System

RTENOTITLE

The RMM 3.3 Agent Plus installer provide three different type installations: Typical, Custom and Complete.

RTENOTITLE

The RMM 3.3 Agent Plus include three program features:

1. MQTT Broker for internal MQTT bus.

2. RMM 3.3 Agent to communicate between WISE-PaaS/RMM Server and MQTT bus.

3. HDD_PMQ Agent for HDD smart retrieve and PMQ caculate then report to MQTT bus.

RTENOTITLE

RTENOTITLE

In rest to steps, the installer will trigger the MQTT Broker, RMM 3.3 Agent and HDD_PMQ Agent installer sequentially.

RTENOTITLE

RTENOTITLE

The detail of RMM 3.3 Agent Installation is skipped to focused on RMM 3.3 Agent Plus Installation.

RTENOTITLE

RTENOTITLE

Update HDD_PMQ Agent

Upload Agent_HDD_PMQ-V1.0.xxx...zip OTA upgrade package to OTA Server.

Upload PMQ.png

Upload PMQ 1.png

Select HDD_PQM Update Package to upgrade target devices.

RTENOTITLE

RTENOTITLE

RTENOTITLE

RTENOTITLE

RTENOTITLE