Edge AI SDK/User Guide 300

From ESS-WIKI
Revision as of 06:49, 20 August 2024 by Seven.lin (talk | contribs) (change "not using" to "do not use")
Jump to: navigation, search

Installation

System Requirements

  • The installation of RTX-A5000 on Intel x86_64 requires 30 GB of Disk Space.
  • The installation of GenAI on Intel 12~13th CPU requires 30 GB of Disk Space and 16 GB physical Memory.
  • The installation of GenAI on Jetson AGX Orin requires 25 GB of Disk Space and 16 GB physical Memory.

 

Install

NOTE:

* Do NOT Use (sudo su or sudo ) to install

* An active Internet connection is required.

* Don't "apt upgrade" before installation

$tar zxvf Edge_AI_SDK-installer-<version>.tar.gz
$./Edge_AI_SDK-installer.run

<img _fck_mw_filename="EAS-installer-run-s1.png" _fck_mw_origimgheight="533" _fck_mw_origimgwidth="786" alt="EAS-installer-run-s1.png" src="/wiki/images/7/79/EAS-installer-run-s1.png" style="vertical-align:middle;" title="EAS-installer-run-s1.png" width="600" />

  • License Aggreement
<img _fck_mw_filename="EAS Install s2.png" _fck_mw_origimgheight="482" _fck_mw_origimgwidth="738" alt="EAS Install s2.png" src="/wiki/images/9/97/EAS_Install_s2.png" style="vertical-align:middle;" title="EAS Install s2.png" width="600" />
  • System Information ( by target platform )
<img _fck_mw_filename="Installer-3.0.0-p1.png" _fck_mw_origimgheight="533" _fck_mw_origimgwidth="786" alt="Installer-3.0.0-p1.png" src="/wiki/images/8/84/Installer-3.0.0-p1.png" style="vertical-align:middle;" title="Installer-3.0.0-p1.png" width="600" />
  • Select AI Accelerator SDK 

<img _fck_mw_filename="Installer-3.0.0-p2.png" _fck_mw_origimgheight="533" _fck_mw_origimgwidth="786" alt="Installer-3.0.0-p2.png" src="/wiki/images/d/da/Installer-3.0.0-p2.png" style="vertical-align:middle;" title="Installer-3.0.0-p2.png" width="600" />

  • Select GenAI SDK 

<img _fck_mw_filename="Installer-3.0.0-p3.png" _fck_mw_origimgheight="533" _fck_mw_origimgwidth="786" alt="Installer-3.0.0-p3.png" src="/wiki/images/b/b0/Installer-3.0.0-p3.png" style="vertical-align:middle;" title="Installer-3.0.0-p3.png" width="600" />

 

Activation

  • User Information. Please fill in the required information one by one, especially a correct email. The following activation will need an available email. Then press the Next button to proceed. 

<img _fck_mw_filename="EAS-Activataion-S1.png" _fck_mw_origimgheight="655" _fck_mw_origimgwidth="1120" alt="EAS-Activataion-S1.png" src="/wiki/images/7/79/EAS-Activataion-S1.png" style="vertical-align:middle;" title="EAS-Activataion-S1.png" width="600" />


 

  • License agreement. Please review EULA and then press the Activation button if the content is agreed.

<img _fck_mw_filename="EAS-Activataion-S2.png" _fck_mw_origimgheight="655" _fck_mw_origimgwidth="1120" alt="EAS-Activataion-S2.png" src="/wiki/images/8/8f/EAS-Activataion-S2.png" style="vertical-align:middle;" title="EAS-Activataion-S2.png" width="600" />


  • Activation Code: If it’s available to access internet, a dialog will pop up to ask you to enter a token for activation.

<img _fck_mw_filename="EAS-Activataion-S3.png" _fck_mw_origimgheight="655" _fck_mw_origimgwidth="1120" alt="EAS-Activataion-S3.png" src="/wiki/images/7/7d/EAS-Activataion-S3.png" style="vertical-align:middle;" title="EAS-Activataion-S3.png" width="600" />


 

Uninstall

cd /opt/Advantech/EdgeAISuite

./unInstall.sh

 

Quick Guide

Edge AI SDK caters to users who are comfortable with the machine learning (ML) experience. It can quickly evaluate computing performance for the CPU or GPU, and provides runtime results inferenced with ML.

Dduble click the icon ( in the red box ) on the Destop to start the Edge AI SDK App.

<img _fck_mw_filename="EdgeAISDK StartApp.jpg" _fck_mw_origimgheight="649" _fck_mw_origimgwidth="1150" alt="Step1.png" src="/wiki/images/5/5d/EdgeAISDK_StartApp.jpg" style="vertical-align:middle;" title="Step1.png" width="600" />

How to Quickly Start Vision AI

Step 1. Go to the “Quick Start (Vision)” page, as shown below.

<img _fck_mw_filename="EAS-UserGuide-Vision-1.png" _fck_mw_origimgheight="655" _fck_mw_origimgwidth="1120" alt="EAS-UserGuide-Vision-1.png" src="/wiki/images/5/5d/EAS-UserGuide-Vision-1.png" style="vertical-align:middle;" title="EAS-UserGuide-Vision-1.png" width="600" />

 

Step 2. Choose one application you want to activate and then confirm inference info, as shown below.

( 1. Object detection, 2. Face detection, 3. Person detection, 4. Pose estimation )

<img _fck_mw_filename="EAS-UserGuide-Vision-2.png" _fck_mw_origimgheight="655" _fck_mw_origimgwidth="1120" alt="EAS-UserGuide-Vision-2.png" src="/wiki/images/a/ac/EAS-UserGuide-Vision-2.png" style="vertical-align:middle;" title="EAS-UserGuide-Vision-2.png" width="600" />

 

Step 3. Choose your video source which could be video clips or the USB Camera, as shown below.

Video ( Note: .MP4 only )

<img _fck_mw_filename="EAS-UserGuide-Vision-3.png" _fck_mw_origimgheight="655" _fck_mw_origimgwidth="1120" alt="EAS-UserGuide-Vision-3.png" src="/wiki/images/7/7a/EAS-UserGuide-Vision-3.png" style="vertical-align:middle;" title="EAS-UserGuide-Vision-3.png" width="600" />  

or USB Camera 

<img _fck_mw_filename="EAS-UserGuide-Vision-4.png" _fck_mw_origimgheight="655" _fck_mw_origimgwidth="1120" alt="EAS-UserGuide-Vision-4.png" src="/wiki/images/7/72/EAS-UserGuide-Vision-4.png" style="vertical-align:middle;" title="EAS-UserGuide-Vision-4.png" width="600" />

 

Step 4. Choose one of the acceleration chipsets to execute selected inference application, as shown below.

( Note:  The available accelerator chipsets depend on your AI system and accelerator card. )

<img _fck_mw_filename="EAS-UserGuide-Vision-5.png" _fck_mw_origimgheight="655" _fck_mw_origimgwidth="1120" alt="EAS-UserGuide-Vision-5.png" src="/wiki/images/e/e7/EAS-UserGuide-Vision-5.png" style="vertical-align:middle;" title="EAS-UserGuide-Vision-5.png" width="600" />  

Step 5. Another window will pop up to show the AI inference, as shown below.

<img _fck_mw_filename="Objection Detect.png" _fck_mw_origimgheight="1071" _fck_mw_origimgwidth="1866" alt="Objection Detect.png" src="/wiki/images/7/73/Objection_Detect.png" style="vertical-align:middle;" title="Objection Detect.png" width="600" />

Object Detection

Object Detection is a computer vision task in which the goal is to detect and locate objects of interest in an image or video. The task involves identifying the position and boundaries of objects in an image, and classifying the objects into different categories. It forms a crucial part of vision recognition, alongside image classification and retrieval.

 

<img _fck_mw_filename="Objection Detect.png" _fck_mw_origimgheight="1071" _fck_mw_origimgwidth="1866" alt="Objection Detect.png" src="/wiki/images/7/73/Objection_Detect.png" style="vertical-align:middle;" title="Objection Detect.png" width="600" />

Person Detection

Person Detection is based on object detection systems that can "detect human classification," i.e., have the data and training to classify the detected object as human. Person detection is used in many different sectors. These can be listed as security, insurance, nursing, health, and production. Technologies offer opportunities that can significantly increase customer satisfaction.

<img _fck_mw_filename="Person Detect.png" _fck_mw_origimgheight="1071" _fck_mw_origimgwidth="1866" alt="Person Detect.png" src="/wiki/images/9/9d/Person_Detect.png" style="vertical-align:middle;" title="Person Detect.png" width="600" />

Face Detection

Facial Detection is the task of making a positive identification of a face in a photo or video image against a pre-existing database of faces. It begins with detection - distinguishing human faces from other objects in the image - and then works on identification of those detected faces.

<img _fck_mw_filename="Face Detect.png" _fck_mw_origimgheight="1071" _fck_mw_origimgwidth="1866" alt="Face Detect.png" src="/wiki/images/3/36/Face_Detect.png" style="vertical-align:middle;" title="Face Detect.png" width="600" />

Pose Estimation

Pose Estimation is a computer vision task where the goal is to detect the position and orientation of a person or an object. Usually, this is done by predicting the location of specific keypoints like hands, head, elbows, etc. in case of Human Pose Estimation.

<img _fck_mw_filename="Pose Detect.png" _fck_mw_origimgheight="1071" _fck_mw_origimgwidth="1866" alt="Pose Detect.png" src="/wiki/images/3/39/Pose_Detect.png" style="vertical-align:middle;" title="Pose Detect.png" width="600" />

How to Quickly Start GenAI

Step 1. Go to the “Quick Start (GenAI)” page, as shown below.

<img _fck_mw_filename="EAS-UserGuide-GenAI-1.png" _fck_mw_origimgheight="655" _fck_mw_origimgwidth="1120" alt="EAS-UserGuide-GenAI-1.png" src="/wiki/images/3/37/EAS-UserGuide-GenAI-1.png" style="vertical-align:middle;" title="EAS-UserGuide-GenAI-1.png" width="600" />

  Step 2. Choose application (chatbot) , as shown below.

<img _fck_mw_filename="EAS-UserGuide-GenAI-2.png" _fck_mw_origimgheight="655" _fck_mw_origimgwidth="1120" alt="EAS-UserGuide-GenAI-2.png" src="/wiki/images/a/a3/EAS-UserGuide-GenAI-2.png" style="vertical-align:middle;" title="EAS-UserGuide-GenAI-2.png" width="600" />

  Step 3. Choose one of the acceleration chipsets to execute selected chatbot application, as shown below.

<img _fck_mw_filename="EAS-UserGuide-GenAI-4.png" _fck_mw_origimgheight="655" _fck_mw_origimgwidth="1120" alt="EAS-UserGuide-GenAI-4.png" src="/wiki/images/2/2f/EAS-UserGuide-GenAI-4.png" style="vertical-align:middle;" title="EAS-UserGuide-GenAI-4.png" width="600" />

  Step 4. Another window will pop up to show the chatbot , as shown below.

<img _fck_mw_filename="EAS-UserGuide-GenAI-5.png" _fck_mw_origimgheight="812" _fck_mw_origimgwidth="910" alt="EAS-UserGuide-GenAI-5.png" src="/wiki/images/5/5b/EAS-UserGuide-GenAI-5.png" style="vertical-align:middle;" title="EAS-UserGuide-GenAI-5.png" width="600" />

 

Monitor AI System Performance

Go to the “System Monitoring” page. This page shows payload and temperature for each chipset, as shown below.

<img _fck_mw_filename="System-info-1.png" _fck_mw_origimgheight="655" _fck_mw_origimgwidth="1120" alt="System-info-1.png" src="/wiki/images/c/c0/System-info-1.png" style="vertical-align:middle;" title="System-info-1.png" width="600" />

 

Evaluate the Benchmark Performance

Go to the “System Monitoring” page and select Visoin. Click the “Run” button to evaluate each chipset performance and wait for a few seconds to get FPS results, as shown below.

<img _fck_mw_filename="Benchmark-vison.png" _fck_mw_origimgheight="655" _fck_mw_origimgwidth="1120" alt="Benchmark-vison.png" src="/wiki/images/c/cb/Benchmark-vison.png" style="vertical-align:middle;" title="Benchmark-vison.png" width="600" />

  Go to the “System Monitoring” page and select GenAI. Click the “Run” button to evaluate each chipset performance and wait for a few seconds to get tokens results, as shown below.

<img _fck_mw_filename="Benchmark-genai.png" _fck_mw_origimgheight="655" _fck_mw_origimgwidth="1120" alt="Benchmark-genai.png" src="/wiki/images/a/a2/Benchmark-genai.png" style="vertical-align:middle;" title="Benchmark-genai.png" width="600" />