Difference between revisions of "Edge AI SDK"

From ESS-WIKI
Jump to: navigation, search
Line 1: Line 1:
  
&nbsp; <span style="font-size:larger;">'''Advantech&nbsp;Edge AI SDK'''&nbsp;offers a consistent development experience for Advantech Edge AI Box (adnd Embedded IPC)</span>. <span style="font-size:larger;">It provides&nbsp;a suitable runtime framework based on platforms like&nbsp;'''Intel x86_64 and&nbsp;NVIDIA Jetson, '''along with AI Accelerators like&nbsp;Intel Arch GPU,&nbsp;Hailo VPU and&nbsp;NVIDIA Card. The SDK&nbsp;also features&nbsp;real-time monitoring, benchmarks,&nbsp; and AI inference examples for hardware.&nbsp;Developers&nbsp;can effortlessly&nbsp;set&nbsp;up an&nbsp;Edge AI environment, allowing&nbsp;them to kickstart their AI applications quickly on&nbsp;Advantech Edge AI platforms&nbsp;with various&nbsp; AI Accelerators.</span>
+
'''Advantech’s Edge AI SDK''' offers a comprehensive platform designed for seamless edge AI development. With pre-configured hardware and perfectly tuned software, it provides a plug-and-play experience, enabling cost-effective customization of LLMs, efficient toolkit compatibility, and effortless management of large-scale edge deployments. Simplify your journey to AI innovation with tools that ensure reliability, scalability, and ease of use.
 +
 
 +
Advantech's Edge AI SDK encompasses three main components:
 +
 
 +
•<u>[https://genai-studio.gitbook.io/docs GenAI]</u><u>[https://genai-studio.gitbook.io/docs Studio]</u>: Facilitates cost-effective creation, evaluation, and integration of custom LLMs on-premises.
 +
 
 +
•<u>[[(待新建page)|Inference Kit]]</u>: Enables rapid optimization and assessment of efficient AI runtimes compatible with embedded operating systems.
 +
 
 +
•<u>[https://campaign.advantech.online/en/DeviceOn/index.html Orchestration Platform]</u>: Provides efficient management of AI model and application updates across extensive edge deployments, integrating MLOps for streamlined operations, powered by [https://campaign.advantech.online/en/DeviceOn/index.html DeviceOn].
  
 
&nbsp;
 
&nbsp;
  
[[File:EdgeAISuite SW Stack.jpg|center|900x600px|Edge AI Suite SW Stack]]
+
[[File:Edge AI SDK Overview.png|center|900x600px|Edge AI SDK Overview]]
  
 
&nbsp;
 
&nbsp;
Line 22: Line 30:
  
 
----
 
----
'''Intel''' '''[[Edge_AI_SDK/AI_Framework/OpenVINO|OpenVINO]]'''<br>
+
 
'''NVIDIA''' '''[[Edge_AI_SDK/AI_Framework/JetsonOrin#JetPack|JetPack]]''', '''[[Edge_AI_SDK/AI_Framework/Nvidia_x86_64#CUDA|CUDA]]''' <br>
+
'''Intel''' '''[[Edge_AI_SDK/AI_Framework/OpenVINO|OpenVINO]]'''<br/> '''NVIDIA''' '''[[Edge_AI_SDK/AI_Framework/JetsonOrin#JetPack|JetPack]]''', '''[[Edge_AI_SDK/AI_Framework/Nvidia_x86_64#CUDA|CUDA]]'''<br/> '''Hailo''' '''[[Edge_AI_SDK/AI_Framework/Hailo#Hailo_AI_Suite|Hailo AI Suite]]'''
'''Hailo''' '''[[Edge_AI_SDK/AI_Framework/Hailo#Hailo_AI_Suite|Hailo AI Suite]]'''
+
 
 
----
 
----
 +
 
'''[[Edge_AI_SDK/DeviceOn|DeviceOn]]'''
 
'''[[Edge_AI_SDK/DeviceOn|DeviceOn]]'''
  
 
|}
 
|}
  
 +
&nbsp;
  
 
| style="width:33%; vertical-align: top;padding-left: 15px;" |  
 
| style="width:33%; vertical-align: top;padding-left: 15px;" |  
Line 37: Line 47:
 
|-
 
|-
 
| style="vertical-align: top;line-height:20px;" |  
 
| style="vertical-align: top;line-height:20px;" |  
'''Intel'''<br/> '''[[Edge_AI_SDK/AI_System/ARK-3534|ARK-3534]]'''<br/> '''[[Edge_AI_SDK/AI_System/AIR-150|AIR-150]]'''<br/> '''[[Edge_AI_SDK/AI_System/AIR-510|AIR-510]]'''<br/>  
+
'''Intel'''<br/> '''[[Edge_AI_SDK/AI_System/ARK-3534|ARK-3534]]'''<br/> '''[[Edge_AI_SDK/AI_System/AIR-150|AIR-150]]'''<br/> '''[[Edge_AI_SDK/AI_System/AIR-510|AIR-510]]'''<br/> '''[[Edge_AI_SDK/AI_System/AFE-R360|AFE-R360]]'''
'''[[Edge_AI_SDK/AI_System/AFE-R360|AFE-R360]]'''
 
  
 
----
 
----
Line 66: Line 75:
 
|}
 
|}
  
 
+
&nbsp;
  
 
{| border="0" cellpadding="0" cellspacing="5" style="width: 100%;"
 
{| border="0" cellpadding="0" cellspacing="5" style="width: 100%;"

Revision as of 09:41, 17 January 2025

Advantech’s Edge AI SDK offers a comprehensive platform designed for seamless edge AI development. With pre-configured hardware and perfectly tuned software, it provides a plug-and-play experience, enabling cost-effective customization of LLMs, efficient toolkit compatibility, and effortless management of large-scale edge deployments. Simplify your journey to AI innovation with tools that ensure reliability, scalability, and ease of use.

Advantech's Edge AI SDK encompasses three main components:

GenAIStudio: Facilitates cost-effective creation, evaluation, and integration of custom LLMs on-premises.

Inference Kit: Enables rapid optimization and assessment of efficient AI runtimes compatible with embedded operating systems.

Orchestration Platform: Provides efficient management of AI model and application updates across extensive edge deployments, integrating MLOps for streamlined operations, powered by DeviceOn.

 

Edge AI SDK Overview

 

Edge AI SDK

User Guide (3.x.0)
User Guide (2.0.1)


Intel OpenVINO
NVIDIA JetPack, CUDA
Hailo Hailo AI Suite


DeviceOn

 

Inference Kit

Intel
ARK-3534
AIR-150
AIR-510
AFE-R360


NVIDIA Jetson
AIR-030

AI Accelerator

Intel
EAI-3100


Hailo
Hailo-8


NVIDIA
RTX-A5000

 

Download FAQ & Tips