Chatbox

Install Chatbox

Visit the Chatbox official website to download the installer for your operating system and install it.

Configure Chatbox

1. After installation, launch Chatbox. Click Settings, then click the Model Provider dropdown and select Add Custom Provider.

2. In the MODEL tab, fill in the service configuration information.

• API Mode: select OpenAI API Compatible
• API Host: enter the IP address of your locally deployed device, in the format http://IP:8000/v1
• API Path: set to /chat/completions
• API Key: not required at this time
• Model: the model name (eg: qwen2.5-0.5B-p256-ax630c)

3. Click the CHAT tab and disable the following options:

• Disable Auto Generate Chat Titles
• Disable Inject default metadata under the CHAT tab

Start Chatting

Click New Chat to create a new conversation, enter your message and send to receive a response from the model.