Repository: resemble-ai/chatterbox

Stars: 24348

README.md Copy Chapter

!Chatterbox Turbo Image

Chatterbox TTS


Made with ♥️ by <a href="https://resemble.ai" target="_blank"><img width="100" alt="resemble-logo-horizontal" src="https://github.com/user-attachments/assets/35cf756b-3506-4943-9c72-c05ddfa4e525" /></a>

Chatterbox is a family of three state-of-the-art, open-source text-to-speech models by Resemble AI.

We are excited to introduce Chatterbox-Turbo, our most efficient model yet. Built on a streamlined 350M parameter architecture, Turbo delivers high-quality speech with less compute and VRAM than our previous models. We have also distilled the speech-token-to-mel decoder, previously a bottleneck, reducing generation from 10 steps to just one, while retaining high-fidelity audio output.

Paralinguistic tags are now native to the Turbo model, allowing you to use [cough], [laugh], [chuckle], and more to add distinct realism. While Turbo was built primarily for low-latency voice agents, it excels at narration and creative workflows.

If you like the model but need to scale or tune it for higher accuracy, check out our competitively priced TTS service (<a href="https://resemble.ai">link</a>). It delivers reliable performance with ultra-low latency of sub 200ms—ideal for production use in agents, applications, or interactive media.

<img width="1200" height="600" alt="Podonos Turbo Eval" src="https://storage.googleapis.com/chatterbox-demo-samples/turbo/podonos_turbo.png" />

⚡ Model Zoo Copy Section

Choose the right model for your application.

| Model | Size | Languages | Key Features | Best For | 🤗 | Examples |
|:----------------------------------------------------------------------------------------------------------------| :--- | :--- |:--------------------------------------------------------|:---------------------------------------------|:--------------------------------------------------------------------------| :--- |
| Chatterbox-Turbo | 350M | English | Paralinguistic Tags ([laugh]), Lower Compute and VRAM | Zero-shot voice agents, Production | Demo | Listen |
| Chatterbox-Multilingual (Language list) | 500M | 23+ | Zero-shot cloning, Multiple Languages | Global applications, Localization | Demo | Listen |
| Chatterbox (Tips and Tricks) | 500M | English | CFG & Exaggeration tuning | General zero-shot TTS with creative controls | Demo | Listen |

Installation Copy Chapter

pip install chatterbox-tts

Alternatively, you can install from source:

conda create -yn chatterbox python=3.11

conda activate chatterbox
git clone https://github.com/resemble-ai/chatterbox.git
cd chatterbox
pip install -e .

Usage Copy Chapter

##### Chatterbox-Turbo

import torchaudio as ta
import torch
from chatterbox.tts_turbo import ChatterboxTurboTTS
Load the Turbo model

model = ChatterboxTurboTTS.from_pretrained(device="cuda")
Generate with Paralinguistic Tags

text = "Hi there, Sarah here from MochaFone calling you back [chuckle], have you got one minute to chat about the billing issue?"
Generate audio (requires a reference clip for voice cloning)

wav = model.generate(text, audio_prompt_path="your_10s_ref_clip.wav")
ta.save("test-turbo.wav", wav, model.sr)

##### Chatterbox and Chatterbox-Multilingual

import torchaudio as ta
from chatterbox.tts import ChatterboxTTS
from chatterbox.mtl_tts import ChatterboxMultilingualTTS
English example

model = ChatterboxTTS.from_pretrained(device="cuda")
text = "Ezreal and Jinx teamed up with Ahri, Yasuo, and Teemo to take down the enemy's Nexus in an epic late-game pentakill."
wav = model.generate(text)
ta.save("test-english.wav", wav, model.sr)
Multilingual examples

multilingual_model = ChatterboxMultilingualTTS.from_pretrained(device=device)
french_text = "Bonjour, comment ça va? Ceci est le modèle de synthèse vocale multilingue Chatterbox, il prend en charge 23 langues."
wav_french = multilingual_model.generate(french_text, language_id="fr")
ta.save("test-french.wav", wav_french, model.sr)
chinese_text = "你好，今天天气真不错，希望你有一个愉快的周末。"
wav_chinese = multilingual_model.generate(chinese_text, language_id="zh")
ta.save("test-chinese.wav", wav_chinese, model.sr)
If you want to synthesize with a different voice, specify the audio prompt

AUDIO_PROMPT_PATH = "YOUR_FILE.wav"
wav = model.generate(text, audio_prompt_path=AUDIO_PROMPT_PATH)
ta.save("test-2.wav", wav, model.sr)

Supported Languages Copy Chapter

Original Chatterbox Tips Copy Chapter

- Expressive or Dramatic Speech:
- Try lower cfg_weight values (e.g. ~0.3) and increase exaggeration to around 0.7 or higher.
- Higher exaggeration tends to speed up speech; reducing cfg_weight helps compensate with slower, more deliberate pacing.

Built-in PerTh Watermarking for Responsible AI Copy Chapter

Every audio file generated by Chatterbox includes Resemble AI's Perth (Perceptual Threshold) Watermarker - imperceptible neural watermarks that survive MP3 compression, audio editing, and common manipulations while maintaining nearly 100% detection accuracy.

Watermark extraction Copy Chapter

You can look for the watermark using the following script.

import perth
import librosa
AUDIO_PATH = "YOUR_FILE.wav"
Load the watermarked audio

watermarked_audio, sr = librosa.load(AUDIO_PATH, sr=None)
Initialize watermarker (same as used for embedding)

watermarker = perth.PerthImplicitWatermarker()
Extract watermark

watermark = watermarker.get_watermark(watermarked_audio, sample_rate=sr)
print(f"Extracted watermark: {watermark}")
Output: 0.0 (no watermark) or 1.0 (watermarked)

Official Discord Copy Chapter

👋 Join us on Discord and let's build something awesome together!

Evaluation Copy Chapter

We compared Chatterbox Turbo to competitive TTS systems using Podonos' standardized evaluation suite, focusing on overall preference, naturalness, and expressiveness.

Evaluation reports:
- Chatterbox Turbo vs ElevenLabs Turbo v2.5
- Chatterbox Turbo vs Cartesia Sonic 3
- Chatterbox Turbo vs VibeVoice 7B

These evaluations were conducted under identical conditions and are publicly accessible via Podonos.

Acknowledgements Copy Chapter

Citation Copy Chapter

@misc{chatterboxtts2025,
  author       = {{Resemble AI}},
  title        = {{Chatterbox-TTS}},
  year         = {2025},
  howpublished = {\url{https://github.com/resemble-ai/chatterbox}},
  note         = {GitHub repository}
}

Disclaimer Copy Chapter