Tools/Audio & Speech/TEN Framework

TEN Framework

Open source framework for building real-time multimodal conversational voice agents.

Open SourceSelf Hosted
0.0 (0)

About

Voice agents that listen, think, and speak in real time are the target workload of the TEN Framework, an open source runtime for multimodal conversational AI backed by Agora. Pipelines are assembled from extensions written in Python, Go, C++, or TypeScript and connected through a low-latency runtime that handles full-duplex audio and video. The ecosystem ships more than the core: TEN VAD for voice activity detection, TEN Turn Detection for natural interruption handling, and agent examples covering voice assistants, speaker diarization, and lip-synced avatars. Deployment is Docker Compose based, using an Agora App ID for real-time transport, and the bundled examples integrate hosted services such as OpenAI, Deepgram, and ElevenLabs, so typical agents pair local components with cloud speech and LLM APIs. The license is Apache-2.0 with additional restrictions defined in the project's license file, worth reviewing before commercial deployment, though the framework is free to use and self-host. With roughly 11,000 GitHub stars it is among the most visible open foundations for production voice agent development.

Should you use TEN Framework?

Pick it when

Pick TEN when you are building a real-time voice or avatar agent with full-duplex audio, want ready VAD and turn detection components, mix extensions in Python, Go, C++, or TypeScript, and are fine using Agora for transport.

Look elsewhere when

Skip it if you want to avoid an Agora account dependency or need a plain permissive license, since its Apache-2.0 terms carry added restrictions. Pipecat (BSD-2-Clause) and LiveKit Agents (Apache-2.0) have plainer licenses.

Alternatives to TEN Framework

  • Pipecat

    BSD-2-Clause with transports over Daily, LiveKit, WebSockets, and telephony, but agents are written in Python rather than multi-language extensions.

  • LiveKit Agents

    Apache-2.0 framework on a self-hostable WebRTC server with SIP telephony built in, though its turn detection models carry a separate LiveKit license.

  • RealtimeSTT

    Only the listening half, in one Python library with VAD and wake words, enough for simple assistants without a full agent runtime or Agora setup.

Reviews (0)

Leave a Review

No reviews yet. Be the first to review!

Details

Price
Free
Platform
Local/Desktop
Difficulty
Intermediate (3/5)
License
Apache-2.0 (with additional restrictions)
Added
Jul 29, 2026

Tags