Getting Started

Install Drivers

1. Download the driver installation package (RELEASE_V1.0.4 or higher is required). Download link: https://console.box.lenovo.com/l/PHk0PF
2. Push the file to the development board, extract it, then complete installation

tar -zxf rknn3_rk182x_m2_installer_arm64.tgz
sudo ./install.sh

Environment Verification

1. Check RK182x Device Status

# Switch to root user if currently logged in as a non-root account
linaro@linaro-alip:/$ [ $(whoami) != "root" ] && sudo su - 
root@linaro-alip:/# rknn-smi info 
+------------------------+---------------+---------------+----------------------+ 
| rknn-smi Version: 1.3.0 | 
+========================+===============+===============+======================+ 
| Device Status | Health | Power(mW) | Npu Utilization(%) | 
| Chip Name | Bus-Id | Temperature(°C) | Memory Usage(MB) | 
+========================+===============+===============+======================+ 
| 0 Online | OK | 81 | 0 | 
| 0 RK1828 | 0000:01:00.0 | 44 | 32 / 5120 | 
+========================+===============+===============+======================+

2. Verify Version Information

# Switch to root user if currently logged in as a non-root account
linaro@linaro-alip:/$ [ $(whoami) != "root" ] && sudo su - 
# Software version details
root@linaro-alip:/# rknn-smi -v 
rknn-smi version : 1.3.0 # Version of rknn-smi utility
PCIe driver version : 3.3.0 # PCIe endpoint driver version
RC chips connect version : 3.3.0 # Version of libchips_connect component on RC side
EP chips connect version : 0.0.2 # Version of libchips_connect component on EP side
rknn3 API version : 1.0.4 # RK1820/RK1828 RKNN runtime version

# Hardware version details
root@linaro-alip:~# rknn-smi info -l
  Device Count                  : 1
    Device ID                     : 0
    Communication mode            : PCIe
    Product Name                  : RM1828MC0
    Serial Number                 : A10CB253900022
    Chip Count                    : 1
      Chip ID                       : 0
      Chip Name                     : RK1828

Model Testing

Cloud disk link for pre-converted RKNN models: RKNN3_SDK (https://console.box.lenovo.com/l/H1fig1, extraction code: rknn)
File path: RKNN3_SDK/rknn3_models/v1.0.4

LLM Model Validation (Taking Qwen3_0.6b as an Example)

1. Upload the model to the development board, move it to the userdata directory, and enter the target folder

# Move model folder
mv /home/linaro/Qwen3-0.6B /userdata/
# Navigate to model directory
cd /userdata/Qwen3-0.6B

1. Run the test command

# Model inference execution command
rknn3_session_test Qwen3-0.6B.rknn Qwen3-0.6B.weight Qwen3-0.6B.tokenizer.gguf Qwen3-0.6B.embed.bin 1024 256 0xff