Added
-
Added
WebsocketServerTransport. This will create a websocket server and will read messages coming from a client. The messages are serialized/deserialized with protobufs. Seeexamples/websocket-serverfor a detailed example. -
Added function calling (
LLMService.register_function()). This will allow the LLM to call functions you have registered when needed. For example, if you register a function to get the weather in Los Angeles and ask the LLM about the weather in Los Angeles, the LLM will call your function. See https://platform.openai.com/docs/guides/function-calling -
Added new
LangchainProcessor. -
Added Cartesia TTS support (https://cartesia.ai/)
Fixed
-
Fixed SileroVAD frame processor.
-
Fixed an issue where
camera_out_enabledwould cause the highg CPU usage if no image was provided.
Performance
- Removed unnecessary audio input tasks.