Difference between revisions of "NXP eIQ"

Revision as of 10:03, 27 September 2023

NXP i.MX series

The i.MX 8M Plus family focuses on neural processing unit (NPU) and vision system, advance multimedia, andindustrial automation with high reliability.

• The Neural Processing Unit (NPU) of i.MX 8M Plus operating at up to 2.3 TOPS

NXP Demo Experience 

• Preinstalled on NXP-provided demo Linux images
• imx-image-full image must be used
• Yocto 3.3 (5.10.52_2.1.0 ) ~ Yocto 4.2 (6.1.1_1.0.0)
• Need to connect the internet

Start the demo launcher by clicking NXP Logo is displayed on the top left-hand corner of the screen

Machine Learning Demos

• NNStreamer demos
  • Object classification
  • Object detection
  • Pose detection
  • Brand detection
  • ML gateway

• OpenCV demos
  • Face recognition
  • Selfie segmentation

NNStreamer Demo: Object Detection

Click the "Object Detection " and Launch Demo

Set some parameters:

• Source: Select the camera to use or to use the example video
• Backend: Select whether to use the NPU (if available) or CPU for inferences.
• Height: Select the input height of the video if using a camera.
• Width: Select the input width of the video if using a camera.
• Label Color: Select the color of the overlay labels.

The result of NPU object detection

eIQ - A Python Framework for eIQ on i.MX Processors

PyeIQ is written on top of eIQ™ ML Software Development Environment and provides a set of Python classes

allowing the user to run Machine Learning applications in a simplified and efficiently way without spending time on

cross-compilations, deployments or reading extensive guides.

Installation

• Method 1: Use pip3 tool to install the package located at PyPI repository:

$ pip3 install eiq

Collecting eiq
 Downloading [https://files.pythonhosted.org/packages/10/54/7a78fca1ce02586a91c88ced1c70acb16ca095779e5c6c8bdd379cd43077/eiq-2.1.0.tar.gz]
Installing collected packages: eiq
 Running setup.py install for eiq ... done
Successfully installed eiq-2.1.0

• Method 2: Get the latest tarball  Download files  and copy it to the board:

$ pip3 install <tarball>

Other eiq versions:

eiq-1.0.0.tar.gz

eiq-2.0.0.tar.gz

eiq-2.1.0.tar.gz

eiq-2.2.0.tar.gz

How to Run Samples

•  Start the manager tool:

$ pyeiq

• The above command returns the PyeIQ manager tool options:

• Common Demos Parameters

Run Applications and Demos

• Applications

• Demos

Applications Example - Switch Detection Video

This application offers a graphical interface for users to run an object detection demo using either CPU or GPU/NPU to perform inference on a video file.

• Run the Switch Detection Video demo using the following line:

  $ pyeiq --run switch_video

• Type on CPU or GPU/NPU in the terminal to switch between cores.
  • This runs inference on a default video:

Demos Example - Running Object Detection SSD

Object detection is a computer technology related to computer vision and image processing that deals with detecting instances of semantic objects of a certain class (such as humans, buildings, or cars) in digital images and videos. Well-researched domains of object detection include face detection and pedestrian detection. Object detection has applications in many areas of computer vision, including image retrieval and video surveillance.

• Run the Object Detection Default Image demo using the following line:

  $ pyeiq --run object_detection_tflite

           *  This runs inference on a default image:

• Run the Object Detection Custom Image demo using the following line:

$ pyeiq --run object_detection_tflite --image=/path_to_the_image

• Run the Object Detection Video File using the following line:

$ pyeiq --run object_detection_tflite --video_src=/path_to_the_video

• Run the Object Detection Video Camera or Webcam using the following line:

$ pyeiq --run object_detection_tflite --video_src=/dev/video<index>