Added
-
Added
DebugLogObserverfor detailed frame logging with configurable filtering by frame type and endpoint. This observer automatically extracts and formats all frame data fields for debug logging. -
UserImageRequestFrame.video_sourcefield has been added to request an image from the desired video source. -
Added support for the AWS Nova Sonic speech-to-speech model with the new
AWSNovaSonicLLMService.
See https://docs.aws.amazon.com/nova/latest/userguide/speech.html.
Note that it requires Python >= 3.12 andpip install pipecat-ai[aws-nova-sonic]. -
Added new AWS services
AWSBedrockLLMServiceandAWSTranscribeSTTService. -
Added
on_active_speaker_changedevent handler to theDailyTransportclass. -
Added
enable_ssml_parsingandenable_loggingtoInputParamsinElevenLabsTTSService. -
Added support to
RimeHttpTTSServicefor thearcanamodel.
Changed
-
Updated
ElevenLabsTTSServiceto use the beta websocket API (multi-stream-input). This new API supports context_ids and cancelling those contexts, which greatly improves interruption handling. -
Observers
on_push_frame()now take a single argumentFramePushedinstead of multiple arguments. -
Updated the default voice for
DeepgramTTSServicetoaura-2-helena-en.
Deprecated
-
PollyTTSServiceis now deprecated, useAWSPollyTTSServiceinstead. -
Observer
on_push_frame(src, dst, frame, direction, timestamp)is now deprecated, useon_push_frame(data: FramePushed)instead.
Fixed
-
Fixed a
DailyTransportissue that was causing issues when multiple audio or video sources where being captured. -
Fixed a
UltravoxSTTServiceissue that would cause the service to generate all tokens as one word. -
Fixed a
PipelineTaskissue that would cause tasks to not be cancelled if task was cancelled from outside of Pipecat. -
Fixed a
TaskManagerthat was causing dangling tasks to be reported. -
Fixed an issue that could cause data to be sent to the transports when they were still not ready.
-
Remove custom audio tracks from
DailyTransportbefore leaving.
Removed
- Removed
CanonicalMetricsServiceas it's no longer maintained.