✨ [NEW] OpenAI Realtime API support
We're partnering with OpenAI on a new MultimodalAgent API in the Agents framework. This class completely wraps OpenAI’s Realtime API, abstract away the raw wire protocol, and provide an ultra-low latency WebRTC transport between GPT-4o and your users’ devices. This same stack powers Advanced Voice in the ChatGPT app.
- Try the Realtime API in our playground [code]
- Check out our guide to building your first app with this new API
Patch Changes
-
bump livekit to v0.17.2 - #815 (@theomonnom)
-
silero: support any sample rate - #805 (@theomonnom)