Edge AI SDK/GenAIChatbot - Revision history

Lin.hsu at 02:42, 26 September 2025

2025-09-26T02:42:18Z

Lin.hsu at 09:48, 25 September 2025

2025-09-25T09:48:53Z

Lin.hsu at 09:44, 25 September 2025

2025-09-25T09:44:14Z

Lin.hsu at 09:41, 25 September 2025

2025-09-25T09:41:11Z

Lin.hsu at 09:36, 25 September 2025

2025-09-25T09:36:24Z

Lin.hsu at 09:33, 25 September 2025

2025-09-25T09:33:41Z

Lin.hsu at 09:32, 25 September 2025

2025-09-25T09:32:16Z

Show changes

Will.qiu at 09:10, 23 September 2025

2025-09-23T09:10:42Z

Will.qiu at 09:10, 23 September 2025

2025-09-23T09:10:15Z

Will.qiu: /* * Chanage Suggest content */

2025-09-23T09:08:55Z

‎* Chanage Suggest content

@@ Line 291: / Line 291: @@
 *<span style="font-size:larger;">''An information button is provided next to each response. Clicking it reveals detailed performance and inference statistics for that response, including token counts, processing speed, and computation time. This allows developers to monitor and optimize system performance in real time.''</span>
-== Using mcp tools ==
+== Using MCP tools ==
 '''1. Verify the default MCP server in the GenAI-Chatbot tools'''

@@ Line 374: / Line 374: @@
 <span style="font-size: 15.6px;">1. Make sure the select model is the RAG model.</span><br/> <span style="font-size:larger;">2. Click the mic icon&nbsp;to start voice mode.</span><br/> <span style="font-size:larger;">3. While speaking, the system will show a listening status.</span><br/> <span style="font-size:larger;">4. After speaking, your question will appear as text.</span><br/> <span style="font-size:larger;">5. The Medical Chatbot Assistant will response and play the answer with audio.</span>
 </div>
-== [[#Using_mcp_tools|Add new mcp server on the Genai-Chatbot]] ==
+== Add new mcp server on the Genai-Chatbot&nbsp;==

@@ Line 374: / Line 374: @@
 <span style="font-size: 15.6px;">1. Make sure the select model is the RAG model.</span><br/> <span style="font-size:larger;">2. Click the mic icon&nbsp;to start voice mode.</span><br/> <span style="font-size:larger;">3. While speaking, the system will show a listening status.</span><br/> <span style="font-size:larger;">4. After speaking, your question will appear as text.</span><br/> <span style="font-size:larger;">5. The Medical Chatbot Assistant will response and play the answer with audio.</span>
 </div>
-== 1. [[#Using_mcp_tools_.28v1.0.1.29|Add new mcp server on the Genai-Chatbot]] ==
+== [[#Using_mcp_tools|Add new mcp server on the Genai-Chatbot]] ==

@@ Line 293: / Line 293: @@
 == Using mcp tools ==
-=== 1. Verify the default MCP server in the GenAI-Chatbot tools ===
+'''1. Verify the default MCP server in the GenAI-Chatbot tools'''
 <div style="display:inline-block; box-shadow:0 4px 16px rgba(0,0,0,0.15); border-radius:12px;">
 [[File:Mcp-tool-1 1757558120013.png|900x600px|Mcp-tool-1 1757558120013.png]]
@@ Line 303: / Line 303: @@
 *<span style="font-size:larger;">Click '''Save''' to apply the changes.</span>
-=== 2. Open a new chat and select the tools ===
+'''2. Open a new chat and select the tools'''
 <div style="display:inline-block; box-shadow:0 4px 16px rgba(0,0,0,0.15); border-radius:12px;">
 [[File:Mcp-tool-2 1757558139296.png|900x600px|Mcp-tool-2 1757558139296.png]]
@@ Line 312: / Line 312: @@
 *<span style="font-size:larger;">Verify that the tool icon appears next to the “+” button, with the number of icons corresponding to the number of selected tools.</span>
-=== 3. Use the tool to obtain system information ===
+'''3. Use the tool to obtain system information'''
 *<span style="font-size:larger;">Example: Ask the LLM model → “'''What is the current memory usage?'''”</span>
@@ Line 318: / Line 318: @@
 [[File:Mcp-tool-3 1756969033152.png|900x600px|Mcp-tool-3 1756969033152.png]]
 </div>
-=== 4. Review the MCP server APIs and available functions ===
+'''4. Review the MCP server APIs and available functions'''
 *<span style="font-size:larger;">MCP - System-Info-Server: [http://localhost:23952/mcp-system-info/docs http://localhost:23952/mcp-system-info/docs]</span>
@@ Line 326: / Line 326: @@
 == Using GenAI Assistant Mode ==
-=== 1. Configure Agent Settings ===
+'''1. Configure Agent Settings'''
 <div style="display:inline-block; box-shadow:0 4px 16px rgba(0,0,0,0.15); border-radius:12px;">
 [[File:Ai-agent-1 1757558170990.png|900x600px|Ai-agent-1 1757558170990.png]]
@@ Line 338: / Line 338: @@
 *<span style="font-size:larger;">Click '''Test''' button.</span>
-=== 2. Start GenAI Assistant Mode ===
+'''2. Start GenAI Assistant Mode'''
 *The GenAI Assistant Mode will appear, allowing you to invoke tools and start a conversation.
@@ Line 348: / Line 348: @@
 &nbsp;
-=== * Change Suggest content ===
+'''Change Suggest content'''
 <div style="display:inline-block; box-shadow:0 4px 16px rgba(0,0,0,0.15); border-radius:12px;">
 [[File:Suggestions1.png|900x600px|Suggestions1.png]]
@@ Line 374: / Line 374: @@
 <span style="font-size: 15.6px;">1. Make sure the select model is the RAG model.</span><br/> <span style="font-size:larger;">2. Click the mic icon&nbsp;to start voice mode.</span><br/> <span style="font-size:larger;">3. While speaking, the system will show a listening status.</span><br/> <span style="font-size:larger;">4. After speaking, your question will appear as text.</span><br/> <span style="font-size:larger;">5. The Medical Chatbot Assistant will response and play the answer with audio.</span>
 </div>
-== Creating an agent to get system information ==
+== 1. [[#Using_mcp_tools_.28v1.0.1.29|Add new mcp server on the Genai-Chatbot]] ==
 === <span style="font-size:large;">1. [[#Using_mcp_tools_.28v1.0.1.29|Add new mcp server on the Genai-Chatbot]]</span> ===

@@ Line 291: / Line 291: @@
 *<span style="font-size:larger;">''An information button is provided next to each response. Clicking it reveals detailed performance and inference statistics for that response, including token counts, processing speed, and computation time. This allows developers to monitor and optimize system performance in real time.''</span>
-== Using mcp tools '''(v1.0.1)''' ==
+== Using mcp tools ==
 === 1. Verify the default MCP server in the GenAI-Chatbot tools ===

← Older revision		Revision as of 09:33, 25 September 2025
Line 13:		Line 13:
	<span style="font-size:larger;">GenAI Chatbot features a flexible configuration suitable for diverse application scenarios and is optimized for embedded platforms such as the Ryzen AI 8000, NVIDIA Jetson Orin Nano, and Jetson Orin AGX.</span>		<span style="font-size:larger;">GenAI Chatbot features a flexible configuration suitable for diverse application scenarios and is optimized for embedded platforms such as the Ryzen AI 8000, NVIDIA Jetson Orin Nano, and Jetson Orin AGX.</span>

−	~~= Release =~~
−
−	~~== Changelog ==~~
−
−	~~=== v1.0.1 - 2025-09-18 ===~~
−
−	~~==== <span style="font-size:larger;">New Features</span> ====~~
−
−	*<span style="font-size:larger;">Added MCP Tool Support : Implemented the Model Context Protocol (MCP), which enables AI agents to perform actions, such as checking system information.</span>
−	*<span style="font-size:larger;">Added GenAI-Agent assistant : This allows you to integrate models with MCP tools, enabling the assistant to invoke tools and start a conversation or task.</span>
−
−	~~==== <span style="font-size:larger;">Platform Support</span> ====~~
−
−	*<span style="font-size:larger;">Added support for AMD Ryzen AI 8000 platforms.</span>
−
−	~~=== v1.0.0 - 2025-07-02 ===~~
−
−	~~==== <span style="font-size:larger;">New Features</span> ====~~
−
−	*<span style="font-size:larger;">Supports audio processing (Speech-to-Text [STT] and Text-to-Speech [TTS]).</span>
−	*<span style="font-size:larger;">Supports Retrieval-Augmented Generation (RAG) for integrating with external knowledge bases.</span>
−	*<span style="font-size:larger;">Includes an embedded vector database (VectorDB).</span>
−
−	~~==== <span style="font-size:larger;">Platform Support</span> ====~~
−
−	*<span style="font-size:larger;">Optimized for NVIDIA Jetson Orin Nano and Jetson Orin AGX platforms.</span>
−
−	~~{\| class="wikitable"~~
−	~~\|+  ~~
−	\|-
−	~~! Feature~~
−	~~! Introduced in Version~~
−	~~! Description~~
−	\|-
−	~~\| GenAI-Agent assistant~~
−	~~\| 1.0.1~~
−	~~\| Integrates models and MCP tools, enabling the assistant to invoke tools and proactively perform tasks.~~
−	\|-
−	~~\| MCP Tools~~
−	~~\| 1.0.1~~
−	~~\| Enables the AI agent to perform actions.~~
−	\|-
−	~~\| AMD Ryzen Platform Support~~
−	~~\| 1.0.1~~
−	~~\| Added support for the Ryzen AI 8000 series.~~
−	\|-
−	~~\| NVIDIA Jetson Platform Support~~
−	~~\| 1.0.0~~
−	~~\| Support for Jetson Orin Nano/AGX.~~
−	\|-
−	~~\| RAG / Audio Processing~~
−	~~\| 1.0.0~~
−	~~\| Initial core features.~~
−	\|}

	= How To =		= How To =

@@ Line 16: / Line 16: @@
 ==== <span style="font-size:larger;"> New Features</span> ====
 * <span style="font-size:larger;">Added MCP Tool Support : Implemented the Model Context Protocol (MCP), which enables AI agents to perform actions, such as checking system information.</span>
-* <span style="font-size:larger;">Added MCP Tool Support : Implemented the Model Context Protocol (MCP), which enables AI agents to perform actions, such as checking system information.</span>
+* <span style="font-size:larger;">Added GenAI-Agent assistant : This allows you to integrate models with MCP tools, enabling the assistant to invoke tools and start a conversation or task.</span>
 ==== <span style="font-size:larger;">Platform Support</span> ====

@@ Line 396: / Line 396: @@
 &nbsp;
-=== * Chanage Suggest content ===
+=== * Change Suggest content ===
 <div style="display:inline-block; box-shadow:0 4px 16px rgba(0,0,0,0.15); border-radius:12px;">
 [[File:Suggestions1.png|900x600px]]