Edge AI SDK/AI Framework/RK3588
Contents
Requirement
| Device | EMMC (recommend physical size) | Full Installed Size |
| ASR-A501 | 64 GB | 135 MB |
| AOM-3821 | 32 GB | 135 MB |
Version
| Device | EdgeAISDK | OS | Support Framework Version |
| AOM-3821 | v3.3.1 | Debian 12 kernel:6.1.75 | |
| ASR-A501 | v3.3.1 | Debian 12 kernel:6.1.75 |
RKNPU2
NVIDIA JetPack SDK is the most comprehensive solution for building end-to-end accelerated AI applications. JetPack provides a full development environment for hardware-accelerated AI-at-the-edge development on Nvidia Jetson modules. JetPack includes Jetson Linux with bootloader, Linux kernel, Ubuntu desktop environment, and a complete set of libraries for acceleration of GPU computing, multimedia, graphics, and computer vision. It also includes samples, documentation, and developer tools for both host computer and developer kit, and supports higher level SDKs such as DeepStream for streaming video analytics, Isaac for robotics, and Riva for conversational AI.
More Info refer to https://developer.nvidia.com/embedded/jetpack
JetPack 5.1.2 includes CUDA 11.4.19, TensorRT 8.5.2, DeepStream 6.2,
RKNN
TensorRT is a high performance deep learning inference runtime for image classification, segmentation, and object detection neural networks. TensorRT is built on CUDA, NVIDIA’s parallel programming model, and enables you to optimize inference for all deep learning frameworks. It includes a deep learning inference optimizer and runtime that delivers low latency and high-throughput for deep learning inference applications.
Applications
Edge AI SDK / Vision Application
| Application | Model | AOM-3821 FPS (video file) | ASR-A501 FPS (video file) |
| Object Detection | yolov10 | 30 | 30 |
| Person Detection | yolov10 | 30 | 30 |
| Face Detection | retinaface | 30 | 30 |
| Pose Estimation | yolov8_pose | 30 | 30 |
Edge AI SDK / GenAI Application
| Version | Application | Model | Note |
| v3.0.0 | LLM Chatbot | Llama-2-7b | |
| v3.3.0 | GenAI Chatbot | Gemma3:4b | Refer to Link |
Benchmark
Jetson is used to deploy a wide range of popular DNN models and ML frameworks to the edge with high performance inferencing, for tasks like real-time classification and object detection, pose estimation, semantic segmentation, and natural language processing (NLP).
More Info refer to [ https://developer.nvidia.com/embedded/jetson-benchmarks ]
More Info refer to [ https://github.com/NVIDIA-AI-IOT/jetson_benchmarks ]
cd /opt/Advantech/EdgeAISuite/Jetson/benchmark
./exec_benchmark.sh
Tegrastats Utility
This SDK provides the tegrastats utility, which reports memory usage and processor usage for Tegra-based devices. You can find the utility in your package at the following location.
More Info refer to Link
