Chatbox

Install Chatbox

Visit the Chatbox official website to download the installer for your operating system and install it.

Configure Chatbox

1. After clicking the Settings option, click Model Provider and Add in sequence .

2. Fill in the service configuration information.

• API Mode: select OpenAI API Compatible
• API Key: not required at this time
• API Host: enter the IP address of your locally deployed device, in the format http://IP:8000/v1
• API Path: set to /chat/completions
• Model: the model name (eg: qwen2.5-0.5B-p256-ax630c)

3. Click the Chat Settings tab and disable the following options:

• Disable Auto-Generate Chat Titles
• Disable Inject default metadata

Start Chatting

Click New Chat to create a new conversation, enter your message and send to receive a response from the model.