Speech-to-Text

Implement input speech conversion to output text via API interface.

Preparation

Before running the example program, the corresponding model package must be installed on the device. Refer to Model List for the model package installation tutorial.

Before running this example program, please ensure the following preparations have been completed on the LLM device:

1. Install the llm-model-whisper-tiny model package using the apt package management tool.

apt install llm-model-whisper-tiny

2. Install the ffmpeg tool.

apt install ffmpeg

3. After installation, restart the OpenAI service to make the new model take effect.

systemctl restart llm-openai-api

Example

On the PC side, use the OpenAI API to pass in an audio file to implement speech-to-text conversion. Before running the example program, modify the IP part of the base_url below to the actual IP address of the device.

from openai import OpenAI
client = OpenAI(
    api_key="sk-",
    base_url="http://192.168.20.186:8000/v1"
)

audio_file = open("speech.mp3", "rb")
transcript = client.audio.transcriptions.create(
  model="whisper-tiny",
  language="en",
  file=audio_file
)

print(transcript)

Request Parameters

Response Example

Transcription(text=' Thank you. Thank you everybody. All right everybody go ahead and have a seat. How\'s everybody doing today? .....', 
logprobs=None, task='transcribe', language='en', duration=334.234, segments=12, sample_rate=16000, channels=1, bit_depth=16)