Audio Format
Rasa uses a common intermediate audio format calledRasaAudioBytes that
acts as a standard data format to prevent complexity between different
channels, ASR engines, and TTS engines.
Rasa supports the following audio formats:
- 8 bit 8KHz μ-law (mulaw) encoding mono channel
- Linear 16 bit 16KHz PCM mono channel
- Linear 16 bit 24KHz PCM mono channel
- Linear 16 bit 48KHz PCM mono channel
sample_rate config property in credentials.yml:
- 8 bit 8KHz mulaw mono
- 16 bit 16KHz PCM mono
- 16 bit 24KHz PCM mono
- 16 bit 48KHz PCM mono
credentials.yml
browser_audio channel used by the Rasa Inspector and by voice-stream browser clients also accepts the sample_rate property. Rasa passes Linear PCM sample rates (16 kHz, 24 kHz, 48 kHz) through end-to-end without server-side resampling.
Rime TTS and Browser channelRime TTS does not support 48KHz sample rate.
If Browser channel is set to 48KHz sample rate, Rasa will resample audio received from Rime
from 24KHz to 48KHz.
ulaw2lin() or lin2ulaw() and ratecv).