v0.6.0 — Realtime Agents & Provider Expansion
Released April 2, 2026 A release focused on expanding what agents can do and how many ways you can build them. Realtime speech-to-speech agents are now supported as a first-class pipeline, 24 new providers cover nearly every major AI vendor, and the playground now shows per-turn latency so you can see exactly where time is spent.✨ What’s New
⚡ Realtime (Speech-to-Speech) Agents
Agents can now run as Realtime agents — a new pipeline mode where a single multimodal model handles speech input and output directly, skipping the cascade STT → LLM → TTS chain. Four realtime providers are supported: OpenAI, Gemini, Azure OpenAI, and xAI. To use it, drop a Realtime Agent node on the canvas and connect one of the four realtime provider nodes. The existing pipeline is now called Cascade Agent for clarity. Both modes support input variables, the playground, and all conversation flow nodes.🌐 24 New AI Providers
LLM providers: Anthropic (direct), Mistral, OpenRouter, AWS Bedrock TTS providers: Groq TTS, Google Cloud TTS, Azure Speech, AWS Polly, Cartesia STT STT providers: ElevenLabs STT, Cartesia STT, AssemblyAI STT, Mistral STT, Google Cloud STT, Azure Speech STT, AWS Transcribe Avatar providers: Anam, Avatario, AvatarTalk, Hedra, Keyframe, LiveAvatar, Simli, Tavus, TruGen The default TTS provider has been switched from ElevenLabs to Cartesia.📊 Provider Latency Metrics
The playground and conversation history now show a LatencyBar beneath each agent turn, breaking down STT, LLM, and TTS latency in milliseconds. The session list also shows average latency per conversation so you can compare providers at a glance. Metrics are collected from LiveKit SDK events, grouped by speech turn, and persisted to the database.🎛️ Adaptive Interruption Handling
The boolean interruption toggle has been replaced with a 3-mode selector on the Agent node:- Off — interruptions disabled
- VAD — voice activity detection, interrupt on any speech
- Adaptive — LiveKit’s TurnHandlingOptions, which learns from the conversation
⚡ Improvements
- Model lists updated to match the latest LiveKit documentation
- agent-python dependencies updated to latest versions