Sesame CSM

Conversational speech model from Sesame that generates Mimi audio codes from text and audio context.

Open SourceSelf HostedOffline CapableGPU Required
0.0 (0)

About

Sesame AI Labs, the company behind the viral Maya voice demo, open-sourced CSM-1B in March 2025 as the base model of its Conversational Speech Model line. Rather than plain text to speech, CSM generates Mimi RVQ audio codes from combined text and audio inputs, using a Llama-style transformer backbone paired with a smaller audio decoder, which lets it produce dialogue speech that responds naturally to the preceding conversation. The weights sit on Hugging Face as sesame/csm-1b under Apache-2.0, and the model is natively integrated into Hugging Face Transformers from version 4.52 onward. Running the reference code requires a CUDA-capable GPU, Python 3.10, and access to the gated Llama-3.2-1B download; Windows users swap in triton-windows for the standard triton dependency. The base release is not tuned to any specific voice and has limited non-English ability, and the usage terms prohibit impersonation and deception. With 14.7k GitHub stars it is one of the most watched open speech releases, used in research on context-aware dialogue synthesis and in self-hosted voice agents.

Reviews (0)

Leave a Review

No reviews yet. Be the first to review!

Details

Price
Free
Platform
Local/Desktop
Difficulty
Intermediate (3/5)
License
Apache-2.0
Added
Jul 29, 2026

Related Tools

Featured

Lightweight and expressive TTS model with 82M parameters for fast local inference.

Open SourceSelf HostedOffline
Easy
4.0 (1)

Conversational TTS model optimized for dialogue and chat applications.

Open SourceSelf HostedOfflineGPU 4GB+
Intermediate
0.0 (0)

Multilingual large voice generation model with full-stack inference, training, and deployment.

Open SourceSelf HostedOfflineGPU
Intermediate
0.0 (0)

Large-scale multilingual TTS model by Alibaba with zero-shot voice cloning.

Open SourceSelf HostedOfflineGPU 8GB+
Advanced
0.0 (0)

Emotion-controllable TTS engine by NetEase with 2000+ voices.

Open SourceSelf HostedOfflineGPU 4GB+
Intermediate
0.0 (0)
Featured

Transformer-based text-to-audio model by Suno that generates speech, music, and sound effects.

Open SourceSelf HostedOfflineGPU 4GB+
Intermediate
0.0 (0)
Browse all Text-to-Speech (TTS) tools