SiMa.ai (hereinafter referred to as SiMa) is a device with strengths in edge AI, rivaling the performance of Alpha Inc., a company that provides GPUs (graphics processing units). There are also voices expressing interest in actually using SiMa's MLSoC (Machine Learning System-on-Chip). In this article, we will introduce how to port a model that was running on Alpha Inc.'s GPU to SiMa and actually run it.
The transplant procedure is as follows:
Step-2: Preparation
Step 3: Environment setup
Step 4: Implementation
The results of this demo video are as follows:
Alpha company video
SiMa Video
This section describes the preparations required before starting development and evaluation.
What you need:
Overall picture of the transplant process
Development on SiMa mainly involves creating AI/ML applications on the host machine.
The host machine is where you do all the work of developing, deploying, and debugging your applications using APIs, frameworks, libraries, CLI tools, etc.
After developing an application, you deploy it from the host machine to the SiMa device and actually run the application on SiMa. The basic development flow is as follows:
Update your development kit firmware to the latest version.
To set up the host machine environment, we will install an application provided by SiMa called Palette.
The application provides a single source of truth for developing, deploying, and debugging AI/ML applications with access to APIs, frameworks, libraries, and Command Line Interface (CLI) tools.
Also, since Palette runs in a Docker container, you will also need to set up a Docker environment.
In order to install Palette, you must meet all of the following installation requirements, so be sure to check them before starting development.
This chapter explains how to operate on Linux.
Installation requirements (as of 11/15/2024)
Requirement Type | detail |
---|---|
Host Machine |
|
OS |
|
Docker Engine |
|
Python |
|
Open Port |
|
Firewall settings |
|
A system that uses Yolov7 to track people's movements and perform heat map analysis of their stay status will be run on SiMa via the host machine.
We use Gstreamer, a framework that makes it easy to process multimedia data.
Connect to device and build*1, Deploy*2This is done using a command set called the MPK tool provided by SiMa.
(*1) Build: Converting source code into an executable file.
(※2) Deploy: Placing an executable file on a server
In the next chapter, we will introduce how to set up the development environment on the development kit and host machine.
Solution Technology Department 3
03-6361-8095Reception hours: Weekdays from 9:00am to 5:00pm