Raspberry Software Package Acquisition

1. Preparation

• Connect to the RaspberryPi device terminal via SSH or other methods.

2. Update Software Sources

1. Copy the following commands to add the GPG key and add M5Stack’s software source information to the system’s source list.

sudo wget -qO /etc/apt/keyrings/StackFlow.gpg https://repo.llm.m5stack.com/m5stack-apt-repo/key/StackFlow.gpg
echo 'deb [arch=arm64 signed-by=/etc/apt/keyrings/StackFlow.gpg] https://repo.llm.m5stack.com/m5stack-apt-repo bookworm llm8850' \
| sudo tee /etc/apt/sources.list.d/StackFlow.list > /dev/null

2. Execute the apt update command to update the package index.

sudo apt update

3. Install Packages

1. View the available llm deb package list. Packages named in the format llm-model-name are model packages, and those named as llm-name are functional unit packages.

apt list | grep llm

2. Install packages as needed using the apt command. For example, to install the llm-whisper package.
   Note: Models will occupy large storage space, it is recommended to install as needed.

sudo apt install llm-whisper

For detailed package information, visit the StackFlow Github package list. It contains model configuration JSON files, showing the model source (homepage), function, and data format.

4. Dependency Packages Introduction

lib-llm

• Provides the runtime environment required for the software.

sudo apt install lib-llm

• Download lib-llm deb

llm-sys

• Provides the basic functions of StackFlow.

sudo apt install llm-sys

• Download llm-sys deb

5. Function Modules Introduction

llm-whisper

• Provides speech-to-text functionality.

sudo apt install llm-whisper

• Download llm-whisper deb

llm-llm

• Provides text generation capability.

sudo apt install llm-llm

• Download llm-llm deb

llm-vlm

• Provides multi-modal text generation capability.

sudo apt install llm-vlm

• Download llm-vlm deb

llm-melotts

• Provides text-to-speech functionality.

sudo apt install llm-melotts

• Download llm-melotts deb

llm-openai-api

• Provides OpenAI API interface.

sudo apt install llm-openai-api

• Download llm-openai-api deb