Orpheus TTS

Speech LLM on a Llama-3B backbone with emotion tags, zero-shot cloning, and 200 ms streaming latency.

Open SourceSelf HostedOffline CapableGPU Required
0.0 (0)

About

Canopy Labs built Orpheus TTS on a Llama-3B backbone, treating speech generation as a language modeling problem, and the result became one of the most widely adopted open text to speech models of 2025. The English 3B model ships in finetuned and pretrained variants, the latter trained on over 100k hours of English speech, with zero-shot voice cloning, guided emotion through inline tags such as laugh and sigh, eight named voices, and streaming inference at roughly 200 ms latency, reducible to about 100 ms with input streaming. A multilingual research preview covers seven language pairs, and the repository includes a finetuning toolkit and audio watermarking support, with 1B, 400M, and 150M variants on the roadmap. Installation is a single pip install orpheus-speech, which pulls in vLLM for realtime GPU serving; community GGUF conversions allow slower CPU inference through llama.cpp. Code and weights are Apache-2.0, so commercial use is permitted, and the repo has grown past 6,000 GitHub stars. Developers embed it in voice agents and realtime assistants that need a self-hostable alternative to hosted speech APIs.

Should you use Orpheus TTS?

Pick it when

Pick Orpheus when you are building an English voice agent that needs emotion tags like laugh and sigh, eight named voices or zero-shot cloning, and about 200 ms streaming from a vLLM server, with Apache-2.0 terms for commercial use.

Look elsewhere when

Skip it if you lack a capable GPU, since the 3B model leans on vLLM and CPU GGUF builds are slower, or if you need production quality beyond English, where the multilingual release is only a research preview. Kokoro suits CPU.

Alternatives to Orpheus TTS

  • Kokoro TTS

    82M model that runs on CPU with eight languages, far cheaper to host, but no emotion tags or voice cloning.

  • Maya1

    Also a 3B Llama-style model with inline emotion tags, but it designs voices from text descriptions instead of cloning and asks for a 16 GB GPU.

  • Chatterbox TTS

    Smaller 350M Turbo backbone with emotion and accent control plus cloning, lighter to serve than a 3B model on modest GPUs.

  • Sesame CSM

    Conditions on prior conversation audio for context-aware dialogue replies, but ships no tuned voice and needs gated Llama access.

Reviews (0)

Leave a Review

No reviews yet. Be the first to review!