LLM-8850 Card Environment Setup

Raspberry Pi Environment Setup

Refer to the following documentation or the official link to complete the Raspberry Pi environment setup. Note: The following commands should be executed in the Raspberry Pi terminal.

Similar to the BIOS in a PC, EEPROM settings are independent of the TF card with the burned OS. Burning the latest Raspberry Pi image or switching image versions will not automatically update the EEPROM settings.

First, execute the update:

sudo apt update && sudo apt full-upgrade

Then, check the version in the EEPROM:

sudo rpi-eeprom-update

If the date you see is earlier than December 6, 2023, run the following command to open the Raspberry Pi configuration CLI:

sudo raspi-config

Under Advanced Options > Bootloader Version, select Latest. Then, exit raspi-config using the Finish or ESC key.

Execute the following command to update the firmware to the latest version:

sudo rpi-eeprom-update -a

Finally, reboot using sudo reboot. After restarting, the firmware in the EEPROM will have been updated.

sudo reboot

After completing the changes and rebooting, you can use the lspci command to check whether the accelerator card is correctly recognized:

lspci

The command output is as follows:

m5stack@raspberrypi5:~ $ lspci
0001:00:00.0 PCI bridge: Broadcom Inc. and subsidiaries BCM2712 PCIe Bridge (rev 30)
0001:01:00.0 Multimedia video controller: Axera Semiconductor Co., Ltd Device 0650 (rev 01)
0002:00:00.0 PCI bridge: Broadcom Inc. and subsidiaries BCM2712 PCIe Bridge (rev 30)
0002:01:00.0 Ethernet controller: Raspberry Pi Ltd RP1 PCIe 2.0 South Bridge

Here, Multimedia video controller: Axera Semiconductor Co., Ltd Device 0650 (rev 01) is the LLM-8850 accelerator card.

LLM-8850 Card Driver Installation

Tip

The development board requires compilation support and depends on the following packages: gcc, make, patch, linux-header-$(uname -r). These need to be installed in advance, or ensure that the network is available during installation.

Update the software source

Use the following command to obtain the aarch64 deb package:

sudo wget -qO /etc/apt/keyrings/StackFlow.gpg https://repo.llm.m5stack.com/m5stack-apt-repo/key/StackFlow.gpg
echo 'deb [signed-by=/etc/apt/keyrings/StackFlow.gpg] https://repo.llm.m5stack.com/m5stack-apt-repo axclhost main' | sudo tee /etc/apt/sources.list.d/axclhost.list

Install using the following command:

sudo apt update

sudo apt install dkms

sudo apt install axclhost

The installation will complete quickly. During installation, environment variables will be automatically added to make the installed .so and executable programs available. Note that if you need the executable programs to be available immediately, you still need to update the bash terminal environment:

source /etc/profile

If you are remotely connecting to the board via ssh, you can also choose to reconnect via ssh for automatic updates (for local terminal login, you can also open a new terminal for automatic updates).

Enter the following command to view the device information:

axcl-smi

The output is as follows:

+------------------------------------------------------------------------------------------------+
| AXCL-SMI  V3.6.4_20250805020145                                  Driver  V3.6.4_20250805020145 |
+-----------------------------------------+--------------+---------------------------------------+
| Card  Name                     Firmware                                                          | Bus-Id       | Memory-Usage           |
| Fan   Temp                Pwr:Usage/Cap                                                          | CPU      NPU | CMM-Usage              |
| =========================================+==============+======================================= |
| 0  AX650N                     V3.6.4                                                             | 0001:01:00.0 | 148 MiB /      945 MiB |
| --   41C                      -- / --                                                            | 2%        0% | 18 MiB /     7040 MiB  |
+-----------------------------------------+--------------+---------------------------------------+

+------------------------------------------------------------------------------------------------+
| Processes:                                                                                       |
| Card      PID  Process Name                                                   NPU Memory Usage   |
| ================================================================================================ |

For details, see the AXCL-SMI section.

LLM-8850 Card Driver Uninstallation

Tip

If you encounter installation problems or need to update the driver, use the following command to uninstall the driver.

sudo apt remove axclhost

Next Overview

Linux PC

CM4Stack

CoreMP135

AI Accelerator Card

LLM-8850 Card

Quick Start

Vision Models

Large Language Models

Multimodal Models

Audio Models

Generative Models

Application List

Advanced Usage

LLM

Real-Time AI Voice Assistant

OpenAI Voice Assistant

XiaoZhi Voice Assistant

XiaoLing Voice Assistant

AtomS3R-M12 Volcengine Kit

Offline Voice Recognition

Unit ASR

Industrial Control

StamPLC

IoT Measuring Instruments

Air Quality

PowerHub

Module13.2 PPS

VAMeter

T-Lite

Input Device

Ezdata

Ethernet Camera

PoECAM

Wi-Fi Camera

TimerCAM

Unit CamS3/-5MP

AI Camera

UnitV2

M5StickV/UnitV

LoRa & LoRaWAN

TTN (The Things Network)

Meshtastic

Motor Control

Unit Roller485/CAN

Develop Tools

Hobby Kit